Lambertian Model-Based Normal Guided Depth Completion for LiDAR-Camera System

被引:6
作者
An, Pei [1 ]
Fu, Wenxing [2 ]
Gao, Yingshuo [1 ]
Ma, Jie [1 ]
Zhang, Jun [1 ]
Yu, Kun [1 ]
Fang, Bin [1 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Inst Artificial Intelligence, Natl Key Lab Sci & Technol Multispectral Informat, Wuhan 430072, Peoples R China
[2] Sci & Technol Complex Syst Control & Intelligent, Beijing 100071, Peoples R China
基金
中国国家自然科学基金;
关键词
Laser radar; Cameras; Three-dimensional displays; Brightness; Surface roughness; Rough surfaces; Pipelines; Depth completion; Lambertian model; light detection and ranging (LiDAR)-camera system;
D O I
10.1109/LGRS.2021.3063379
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Depth completion is an essential task for the dense scene reconstruction on light detection and ranging (LiDAR)-camera system. Learning-based method achieves precise depth completion results on specific data sets. However, for the general outdoor scenes with insufficient labeled data sets, an efficient nonlearning method is still required. In this letter, from the geometrical constraint between depth and normal, a novel nonlearning normal guided depth completion method is proposed. For the objects in the outdoor scene, local brightness normal (LBN) constraint is derived from the Lambertian model. It is used to recover dense normal from RGB image and sparse normal. After that, we present a pipeline for depth completion with the guidance of dense normal. Extensive experiments on the KITTI depth completion data set demonstrate that our method achieves smaller root mean squared error (RMSE) than current nonlearning methods.
引用
收藏
页数:5
相关论文
共 21 条
[1]  
[Anonymous], 2016, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2016.482
[2]   The Fast Bilateral Solver [J].
Barron, Jonathan T. ;
Poole, Ben .
COMPUTER VISION - ECCV 2016, PT III, 2016, 9907 :617-632
[3]  
Chen YC, 2019, IEEE VTS VEH TECHNOL, DOI [10.1109/vtcspring.2019.8746552, 10.4324/9780429425882]
[4]  
Do, 2014, J ELECTRON IMAGING, V13, P515
[5]   Image Guided Depth Upsampling using Anisotropic Total Generalized Variation [J].
Ferstl, David ;
Reinbacher, Christian ;
Ranftl, Rene ;
Ruether, Matthias ;
Bischof, Horst .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, :993-1000
[6]  
Geiger A., 2012, C COMP VIS PATT REC
[7]   Guided depth enhancement via a fast marching method [J].
Gong, Xiaojin ;
Liu, Junyi ;
Zhou, Wenhui ;
Liu, Jilin .
IMAGE AND VISION COMPUTING, 2013, 31 (10) :695-703
[8]   Guided Image Filtering [J].
He, Kaiming ;
Sun, Jian ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (06) :1397-1409
[9]   In Defense of Classical Image Processing: Fast Depth Completion on the CPU [J].
Ku, Jason ;
Harakeh, Ali ;
Waslander, Steven L. .
2018 15TH CONFERENCE ON COMPUTER AND ROBOT VISION (CRV), 2018, :16-22
[10]  
Lee BU, 2019, IEEE INT CONF ROBOT, P3281, DOI [10.1109/ICRA.2019.8794161, 10.1109/icra.2019.8794161]