MDCS with fully encoding the information of local shape description for 3D Rigid Data matching

被引:14
作者
Du, Zhihua [1 ]
Zuo, Yong [1 ]
Qiu, Jifang [1 ]
Li, Xiang [1 ]
Li, Yan [1 ]
Guo, Hongxiang [1 ]
Hong, Xiaobin [1 ]
Wu, Jian [1 ]
机构
[1] Beijing Univ Post & Telecommun, Sch Elect Engn, Beijing 100876, Peoples R China
关键词
Local feature description; 3D rigid data matching; Multi-view; Local reference frame (LRF); OBJECT RECOGNITION; PAIRWISE REGISTRATION; UNIQUE SIGNATURES; POSE ESTIMATION; SURFACE; HISTOGRAMS; GEOMETRY; SETS;
D O I
10.1016/j.imavis.2022.104421
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Local feature description is the fundamental research topic for 3D rigid data matching. However, how to achieve a good balanced performance of the local shape descriptor among descriptiveness, robustness, compactness and efficiency remains a challenging task. For this purpose, we propose a novel feature representation of 3D local surface called multi-view depth and contour signatures (MDCS). Key to MDCS descriptor is multi-view and multi attribute description to provide a comprehensive and effective geometric information. Specifically, we first construct a repeatable Local Reference Frame (LRF) for the local surface to achieve rotation invariance. Then we integrate the depth information characterized in a local coordinate manner and the 2D contour cue derived from 3D-to-2D projection, forming the depth and contour signatures (DCS). Finally, MDCS is generated by concatenating all the DCS descriptors captured from three orthogonal view planes in the LRF into a vector. The performance of the MDCS method is evaluated on several data modalities (i.e., LiDAR, Kinect, and Space Time) with respect to Gaussian noise, varying mesh resolutions, clutter and occlusion. Experimental results and rigorous comparisons with the state-of-the-arts validate that our approach achieves the superior performance in terms of descriptiveness, robustness, compactness and efficiency. Moreover, we further demonstrate the feasibility of MDCS in matching of both LiDAR and Kinect point clouds for 3D vision applications and evaluate the generalization ability of the proposed method on real-world datasets.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 41 条
[1]   SGHs for 3D local surface description [J].
Ao, Sheng ;
Guo, Yulan ;
Gu, Shangtai ;
Tian, Jindong ;
Li, Dong .
IET COMPUTER VISION, 2020, 14 (04) :154-161
[2]  
Ao Sheng, 2020, ARXIV201112149
[3]   3D shape descriptor for object recognition based on Kinect-like depth image [J].
As'ari, M. A. ;
Sheikh, U. U. ;
Supriyanto, E. .
IMAGE AND VISION COMPUTING, 2014, 32 (04) :260-269
[4]  
Curless B., 1996, Computer Graphics Proceedings. SIGGRAPH '96, P303, DOI 10.1145/237170.237269
[5]   3-D Mapping With an RGB-D Camera [J].
Endres, Felix ;
Hess, Juergen ;
Sturm, Juergen ;
Cremers, Daniel ;
Burgard, Wolfram .
IEEE TRANSACTIONS ON ROBOTICS, 2014, 30 (01) :177-187
[6]  
Frome A, 2004, LECT NOTES COMPUT SC, V3023, P224
[7]   The Perfect Match: 3D Point Cloud Matching with Smoothed Densities [J].
Gojcic, Zan ;
Zhou, Caifa ;
Wegner, Jan D. ;
Wieser, Andreas .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :5540-5549
[8]   A Comprehensive Performance Evaluation of 3D Local Feature Descriptors [J].
Guo, Yulan ;
Bennamoun, Mohammed ;
Sohel, Ferdous ;
Lu, Min ;
Wan, Jianwei ;
Kwok, Ngai Ming .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2016, 116 (01) :66-89
[9]   An Integrated Framework for 3-D Modeling, Object Detection, and Pose Estimation From Point-Clouds [J].
Guo, Yulan ;
Bennamoun, Mohammed ;
Sohel, Ferdous ;
Lu, Min ;
Wan, Jianwei .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2015, 64 (03) :683-693
[10]   3D Object Recognition in Cluttered Scenes with Local Surface Features: A Survey [J].
Guo, Yulan ;
Bennamoun, Mohammed ;
Sohel, Ferdous ;
Lu, Min ;
Wan, Jianwei .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2014, 36 (11) :2270-2287