Curvature Regularization for Non-Line-of-Sight Imaging From Under-Sampled Data

被引:2
|
作者
Ding, Rui [1 ]
Ye, Juntian [2 ,3 ]
Gao, Qifeng [1 ]
Xu, Feihu [2 ,3 ]
Duan, Yuping [4 ]
机构
[1] Tianjin Univ, Ctr Appl Math, Tianjin 300072, Peoples R China
[2] Univ Sci & Technol China, Hefei Natl Lab Phys Sci, Microscale, Hefei 230026, Peoples R China
[3] Univ Sci & Technol China, Sch Phys Sci, Hefei 230026, Peoples R China
[4] Beijing Normal Univ, Sch Math Sci, Beijing 100875, Peoples R China
基金
中国国家自然科学基金;
关键词
Image reconstruction; Imaging; Surface reconstruction; Reconstruction algorithms; Iterative methods; Three-dimensional displays; Photonics; Non-line-of-sight; under-sampled scanning; curvature regularization; dual-domain reconstruction; GPU implementation; RECONSTRUCTION; ELASTICA; MODEL;
D O I
10.1109/TPAMI.2024.3409414
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Non-line-of-sight (NLOS) imaging aims to reconstruct the three-dimensional hidden scenes by using time-of-flight photon information after multiple diffuse reflections. The under-sampled scanning data can facilitate fast imaging. However, the resulting reconstruction problem becomes a serious ill-posed inverse problem, the solution of which is highly likely to be degraded due to noises and distortions. In this paper, we propose novel NLOS reconstruction models based on curvature regularization, i.e., the object-domain curvature regularization model and the dual (signal and object)-domain curvature regularization model. In what follows, we develop efficient optimization algorithms relying on the alternating direction method of multipliers (ADMM) with the backtracking stepsize rule, for which all solvers can be implemented on GPUs. We evaluate the proposed algorithms on both synthetic and real datasets, which achieve state-of-the-art performance, especially in the compressed sensing setting. Based on GPU computing, our algorithm is the most effective among iterative methods, balancing reconstruction quality and computational time.
引用
收藏
页码:8474 / 8485
页数:12
相关论文
共 50 条
  • [1] Thermal Non-Line-of-Sight Imaging
    Maeda, Tomohiro
    Wang, Yiqin
    Raskar, Ramesh
    Kadambi, Achuta
    2019 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL PHOTOGRAPHY (ICCP), 2019,
  • [2] Non-line-of-sight imaging
    Faccio, Daniele
    Velten, Andreas
    Wetzstein, Gordon
    NATURE REVIEWS PHYSICS, 2020, 2 (06) : 318 - 327
  • [3] Passive Terahertz Non-Line-of-Sight Imaging
    Grossman, Erich N.
    Sasaki, Takahiro
    Leger, James R.
    IEEE TRANSACTIONS ON TERAHERTZ SCIENCE AND TECHNOLOGY, 2022, 12 (05) : 489 - 498
  • [4] Non-line-of-Sight Imaging via Neural Transient Fields
    Shen, Siyuan
    Wang, Zi
    Liu, Ping
    Pan, Zhengqing
    Li, Ruiqian
    Gao, Tian
    Li, Shiying
    Yu, Jingyi
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (07) : 2257 - 2268
  • [5] Passive Non-Line-of-Sight Imaging With Light Transport Modulation
    Zhang, Jiarui
    Geng, Ruixu
    Du, Xiaolong
    Chen, Yan
    Li, Houqiang
    Hu, Yang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2025, 34 : 410 - 424
  • [6] FPGA Accelerator for Real-Time Non-Line-of-Sight Imaging
    Liao, Zhengpeng
    Jiang, Deyang
    Liu, Xiaochun
    Velten, Andreas
    Ha, Yajun
    Lou, Xin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2022, 69 (02) : 721 - 734
  • [7] Non-line-of-sight imaging based on Archimedean spiral scanning
    Zhang, Meiling
    Shi, Yaoyao
    Sheng, Wei
    Liu, Jiaqing
    Li, Jingwen
    Wei, Yang
    Wang, Bin
    Zhang, Dejin
    Liu, Youwen
    OPTICS COMMUNICATIONS, 2023, 537
  • [8] Passive Non-Line-of-Sight Imaging Using Optimal Transport
    Geng, Ruixu
    Hu, Yang
    Lu, Zhi
    Yu, Cong
    Li, Houqiang
    Zhang, Hengyu
    Chen, Yan
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 110 - 124
  • [9] Error Backprojection Algorithms for Non-Line-of-Sight Imaging
    La Manna, Marco
    Kine, Fiona
    Breitbach, Eric
    Jackson, Jonathan
    Sultan, Talha
    Velten, Andreas
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (07) : 1615 - 1626
  • [10] Thermal non-line-of-sight imaging from specular and diffuse reflections
    Kaga M.
    Kushida T.
    Takatani T.
    Tanaka K.
    Funatomi T.
    Mukaigawa Y.
    IPSJ Transactions on Computer Vision and Applications, 2019, 11 (01):