Learning Representative Features by Deep Attention Network for 3D Point Cloud Registration

被引:2
作者
Xia, Xiaokai [1 ,2 ]
Fan, Zhiqiang [2 ]
Xiao, Gang [1 ]
Chen, Fangyue [2 ]
Liu, Yu [3 ]
Hu, Yiheng [4 ]
机构
[1] Beijing Inst Syst Engn, Beijing 100101, Peoples R China
[2] China Elect Technol Grp Corp, Artificial Intelligence Inst, Beijing 100041, Peoples R China
[3] Beihang Univ, State Key Lab Software Dev Environm, Beijing 100191, Peoples R China
[4] Univ New South Wales, Sch Comp Sci & Engn, Sydney, NSW 2052, Australia
关键词
point cloud; deep learning; registration; feature extraction; HISTOGRAMS;
D O I
10.3390/s23084123
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Three-dimensional point cloud registration, which aims to find the transformation that best aligns two point clouds, is a widely studied problem in computer vision with a wide spectrum of applications, such as underground mining. Many learning-based approaches have been developed and have demonstrated their effectiveness for point cloud registration. Particularly, attention-based models have achieved outstanding performance due to the extra contextual information captured by attention mechanisms. To avoid the high computation cost brought by attention mechanisms, an encoder-decoder framework is often employed to hierarchically extract the features where the attention module is only applied in the middle. This leads to the compromised effectiveness of the attention module. To tackle this issue, we propose a novel model with the attention layers embedded in both the encoder and decoder stages. In our model, the self-attentional layers are applied in the encoder to consider the relationship between points inside each point cloud, while the decoder utilizes cross-attentional layers to enrich features with contextual information. Extensive experiments conducted on public datasets prove that our model is able to achieve quality results on a registration task.
引用
收藏
页数:15
相关论文
共 33 条
[1]   D3Feat: Joint Learning of Dense Detection and Description of 3D Local Features [J].
Bai, Xuyang ;
Luo, Zixin ;
Zhou, Lei ;
Fu, Hongbo ;
Quan, Long ;
Tai, Chiew-Lan .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :6358-6366
[2]   A METHOD FOR REGISTRATION OF 3-D SHAPES [J].
BESL, PJ ;
MCKAY, ND .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1992, 14 (02) :239-256
[3]   Deep Global Registration [J].
Choy, Christopher ;
Dong, Wei ;
Koltun, Vladlen .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :2511-2520
[4]   Fully Convolutional Geometric Features [J].
Choy, Christopher ;
Park, Jaesik ;
Koltun, Vladlen .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :8957-8965
[5]   4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks [J].
Choy, Christopher ;
Gwak, JunYoung ;
Savarese, Silvio .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3070-3079
[6]   Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis [J].
Dai, Angela ;
Qi, Charles Ruizhongtai ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6545-6554
[7]   StickyPillars: Robust and Efficient Feature Matching on Point Clouds using Graph Neural Networks [J].
Fischer, Kai ;
Simon, Martin ;
Oelsner, Florian ;
Milz, Stefan ;
Gross, Horst-Michael ;
Maeder, Patrick .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :313-323
[8]  
Fu KX, 2023, IEEE T PATTERN ANAL, V45, P6183, DOI [10.1109/TPAMI.2022.3204713, 10.1109/CVPR46437.2021.00878]
[9]   Learning multiview 3D point cloud registration [J].
Gojcic, Zan ;
Zhou, Caifa ;
Wegner, Jan D. ;
Guibas, Leonidas J. ;
Birdal, Tolga .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :1756-1766
[10]   PREDATOR: Registration of 3D Point Clouds with Low Overlap [J].
Huang, Shengyu ;
Gojcic, Zan ;
Usvyatsov, Mikhail ;
Wieser, Andreas ;
Schindler, Konrad .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :4265-4274