Non-line-of-sight Imaging with Signal Superresolution Network

被引:14
作者
Wang, Jianyu [1 ]
Liu, Xintong [1 ]
Xiao, Leping [1 ]
Shi, Zuoqiang [1 ,2 ]
Qiu, Lingyun [1 ,2 ]
Fu, Xing [1 ]
机构
[1] Tsinghua Univ, Beijing, Peoples R China
[2] Yanqi Lake Beijing Inst Math Sci & Applicat, Beijing, Peoples R China
来源
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) | 2023年
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR52729.2023.01671
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Non-line-of-sight (NLOS) imaging aims at reconstructing the location, shape, albedo, and surface normal of the hidden object around the corner with measured transient data. Due to its strong potential in various fields, it has drawn much attention in recent years. However, long exposure time is not always available for applications such as auto-driving, which hinders the practical use of NLOS imaging. Although scanning fewer points can reduce the total measurement time, it also brings the problem of imaging quality degradation. This paper proposes a general learning-based pipeline for increasing imaging quality with only a few scanning points. We tailor a neural network to learn the operator that recovers a high spatial resolution signal. Experiments on synthetic and measured data indicate that the proposed method provides faithful reconstructions of the hidden scene under both confocal and non-confocal settings. Compared with original measurements, the acquisition of our approach is 16 times faster while maintaining similar reconstruction quality. Besides, the proposed pipeline can be applied directly to existing optical systems and imaging algorithms as a plug-in-and-play module. We believe the proposed pipeline is powerful in increasing the frame rate in NLOS video imaging.
引用
收藏
页码:17420 / 17429
页数:10
相关论文
共 45 条
[1]   Convolutional Approximations to the General Non-Line-of-Sight Imaging Operator [J].
Ahn, Byeongjoo ;
Dave, Akshat ;
Veeraraghavan, Ashok ;
Gkioulekas, Ioannis ;
Sankaranarayanan, Aswin C. .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :7888-7898
[2]   A Deep Journey into Super-resolution: A Survey [J].
Anwar, Saeed ;
Khan, Salman ;
Barnes, Nick .
ACM COMPUTING SURVEYS, 2020, 53 (03)
[3]   Fast back-projection for non-line of sight reconstruction [J].
Arellano, Victor ;
Gutierrez, Diego ;
Jarabo, Adrian .
OPTICS EXPRESS, 2017, 25 (10) :11574-11583
[4]   A comprehensive review of deep learning-based single image super-resolution [J].
Bashir, Syed Muhammad Arsalan ;
Wang, Yi ;
Khan, Mahrukh ;
Niu, Yilong .
PEERJ COMPUTER SCIENCE, 2021,
[5]  
Chang A X, 2015, COMPUTER SCI, V1512, P3
[6]  
Chen Haoyu, 2021, ARXIV210409497
[7]   DeepFaceDrawing: Deep Generation of Face Images from Sketches [J].
Chen, Shu-Yu ;
Su, Wanchao ;
Gao, Lin ;
Xia, Shihong ;
Fu, Hongbo .
ACM TRANSACTIONS ON GRAPHICS, 2020, 39 (04)
[8]   Steady-state Non-Line-of-Sight Imaging [J].
Chen, Wenzheng ;
Daneau, Simon ;
Mannan, Fahim ;
Heide, Felix .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3783-6792
[9]   On Robustness of Neural Architecture Search Under Label Noise [J].
Chen, Yi-Wei ;
Song, Qingquan ;
Liu, Xi ;
Sastry, P. S. ;
Hu, Xia .
FRONTIERS IN BIG DATA, 2020, 3
[10]   Deep Non-Line-Of-Sight Reconstruction [J].
Chopite, Javier Grau ;
Hullin, Matthias B. ;
Wand, Michael ;
Iseringhausen, Julian .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :957-966