BAYESIAN DEEP UNFOLDING WITH GRAPH ATTENTION FOR DUAL-PEAK SINGLE-PHOTON LIDAR IMAGING

被引:0
作者
Koo, JaKeoung [1 ]
Halimi, Abderrahim [2 ]
McLaughlin, Stephen [2 ]
机构
[1] Gachon Univ, Sch Comp, Seongnam, South Korea
[2] Heriot Watt Univ, Edinburgh, Midlothian, Scotland
来源
32ND EUROPEAN SIGNAL PROCESSING CONFERENCE, EUSIPCO 2024 | 2024年
基金
新加坡国家研究基金会; 英国工程与自然科学研究理事会;
关键词
3D reconstruction; single-photon imaging; Lidar; obscurants; algorithm unrolling; attention 3D reconstruction; Single-photon lidar; Single-photon imaging; Algorithm unrolling; Geometric deep learning; RECONSTRUCTION; SIGNAL; ROBUST;
D O I
10.23919/EUSIPCO63174.2024.10715221
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Single-photon Lidar is a promising 3D imaging technique, but it is challenging to deploy in real-world applications due to high noise levels and the presence of multiple surfaces per pixel. Existing statistical methods are interpretable, but limited by the assumed model. Data-driven approaches show excellent performance, but with limited interpretability, preventing their use in critical applications. In this paper, we propose an interpretable deep learning architecture with graph attention networks for the reconstruction of dual peaks per pixel in single photon Lidar. Instead of the conventional image-based representation, we represent the solution as point clouds, allowing reconstruction of more than one surface per pixel. The proposed architecture is based on a statistical Bayesian algorithm, whose iterative steps are converted into neural network layers. This approach combines the advantages of both statistical and learning-based frameworks, providing good estimates with improved network interpretability. Experimental results demonstrate the effectiveness of the proposed method.
引用
收藏
页码:646 / 650
页数:5
相关论文
共 21 条
[1]  
Brody S., 2022, INT C LEARN REPR ICL
[2]   A Naturalistic Open Source Movie for Optical Flow Evaluation [J].
Butler, Daniel J. ;
Wulff, Jonas ;
Stanley, Garrett B. ;
Black, Michael J. .
COMPUTER VISION - ECCV 2012, PT VI, 2012, 7577 :611-625
[3]   Robust and Guided Bayesian Reconstruction of Single-Photon 3D Lidar Data: Application to Multispectral and Underwater Imaging [J].
Halimi, Abderrahim ;
Maccarone, Aurora ;
A. Lamb, Robert ;
S. Buller, Gerald ;
McLaughlin, Stephen .
IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2021, 7 :961-974
[4]   Robust Restoration of Sparse Multidimensional Single-Photon LiDAR Images [J].
Halimi, Abderrahim ;
Tobin, Rachael ;
McCarthy, Aongus ;
Bioucas-Dias, Jose ;
McLaughlin, Stephen ;
Buller, Gerald S. .
IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 :138-152
[5]  
Halimi A, 2016, EUR SIGNAL PR CONF, P86, DOI 10.1109/EUSIPCO.2016.7760215
[6]  
Hirschmüller H, 2007, PROC CVPR IEEE, P2134
[7]  
Jang Eric, INT C LEARN REPR ICL
[8]  
Koo J, 2022, EUR SIGNAL PR CONF, P872
[9]   A Bayesian Based Deep Unrolling Algorithm for Single-Photon Lidar Systems [J].
Koo, Jakeoung ;
Halimi, Abderrahim ;
McLaughlin, Stephen .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2022, 16 (04) :762-774
[10]   Single-Photon 3D Imaging with Deep Sensor Fusion [J].
Lindell, David B. ;
O'Toole, Matthew ;
Wetzstein, Gordon .
ACM TRANSACTIONS ON GRAPHICS, 2018, 37 (04)