MFINet: a multi-scale feature interaction network for point cloud registration

被引:0
作者
Cao, Haiyuan [1 ]
Chen, Deng [1 ]
Zhang, Yanduo [2 ]
Zhou, Huabing [1 ]
Wen, Dawei [1 ]
Cao, Congcong [3 ]
机构
[1] Wuhan Inst Technol, Hubei Prov Key Lab Intelligent Robot, Wuhan 430079, Peoples R China
[2] Hubei Univ Arts & Sci, Comp Sch, Xiangyang 441053, Peoples R China
[3] Changsha Med Univ, Sch Stomatol, Changsha 410219, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud registration; Deep learning; Multi-branch feature extraction; Feature interaction; Multi-scale feature fusion;
D O I
10.1007/s00371-024-03646-2
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Point cloud registration is widely applied in computer vision field. Previous learning-based registration methods focus on extracting global information from the input and ignore local neighborhood information, which makes it difficult to further improve the registration accuracy. In this work, we present MFINet, a multi-scale feature interaction network that can extract multi-scale features and adaptively fuse these features. To achieve this, we use the K-nearest neighbors algorithm to search for the neighborhood of each point in the input, extract local features at different scales in parallel, and perform feature interactions at the feature extractor to enhance the information correlation between the inputs. Next, we propose a multi-scale feature fusion module that learns appropriate weights for each feature extractor branch and fuses these multi-scale features by weighted combination to enhance the representation ability of features. Finally, a dual-branch structure is used to predict the rotation quaternion and translation vector to mitigate the influence of the disparity in solution space between rotation and translation on the registration performance. Experiments on the ModelNet40 dataset show that the MFINet outperforms previous methods in terms of registration accuracy and robustness against noise, and also exhibits a stable generalization capability on the Stanford 3D Scan dataset. Code is available at https://github.com/daqi01/MFINet-master.
引用
收藏
页码:4067 / 4079
页数:13
相关论文
共 44 条
[1]   PointNetLK: Robust & Efficient Point Cloud Registration using PointNet [J].
Aoki, Yasuhiro ;
Goforth, Hunter ;
Srivatsan, Rangaprasad Arun ;
Lucey, Simon .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :7156-7165
[2]   A METHOD FOR REGISTRATION OF 3-D SHAPES [J].
BESL, PJ ;
MCKAY, ND .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1992, 14 (02) :239-256
[3]   Fast Point Cloud Registration Method with Incorporation of RGB Image Information [J].
Cao, Haiyuan ;
Chen, Deng ;
Zheng, Zhaohui ;
Zhang, Yanduo ;
Zhou, Huabing ;
Ju, Jianping .
APPLIED SCIENCES-BASEL, 2023, 13 (08)
[4]   Deep Global Registration [J].
Choy, Christopher ;
Dong, Wei ;
Koltun, Vladlen .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :2511-2520
[5]  
Curless B., 1996, Computer Graphics Proceedings. SIGGRAPH '96, P303, DOI 10.1145/237170.237269
[6]   Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis [J].
Dai, Angela ;
Qi, Charles Ruizhongtai ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6545-6554
[7]  
Dai LT, 2024, NAT PROD RES, DOI [10.1038/s41591-023-02702-z, 10.1080/14786419.2024.2394834]
[8]   PPFNet: Global Context Aware Local Features for Robust 3D Point Matching [J].
Deng, Haowen ;
Birdal, Tolga ;
Ilie, Slobodan .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :195-205
[9]  
Eckart B., 2020, ARXIV, Vabs, P09088
[10]   The farthest point strategy for progressive image sampling [J].
Eldar, Y ;
Lindenbaum, M ;
Porat, M ;
Zeevi, YY .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 1997, 6 (09) :1305-1315