3-D Line Matching Network Based on Matching Existence Guidance and Knowledge Distillation

被引:0
作者
Tang, Jie [1 ]
Liu, Yong [1 ]
Yu, Bo [2 ]
Liu, Xue [3 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510000, Peoples R China
[2] Shenzhen Inst Artificial Intelligence & Robot Soc, Embodied Intelligence Ctr, Shenzhen 518000, Peoples R China
[3] McGill Univ, Montreal, PQ H3A 0G4, Canada
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 20期
基金
中国国家自然科学基金;
关键词
Three-dimensional displays; Noise; Data models; Solid modeling; Feature extraction; Vectors; Pose estimation; 3-D lines matching; knowledge distillation; Pl & uuml; cker lines;
D O I
10.1109/JIOT.2024.3429352
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In applications, such as scene reconstruction and odometry, accurate matching associations for 3-D lines are crucial. Real-world scenes introduce inconsistencies due to variations in perspective, leading to nonoverlapping data acting as noise. Accurately matching partially overlapping sets of 3-D lines becomes challenging, potentially resulting in failed scene reconstruction and erroneous positioning. Prior approaches relied on the traditional iterative closest line (ICL) methods, involving iterative calculations and sensitivity to initial poses, and were prone to matching failures in low-overlap rate data and singular pattern scenes. Existing 3-D line matching networks either did not consider the noise in 3-D line collections or failed to retain more valid matching pairs, while these models often require a larger number of parameters and inference time. To address these issues, this article proposes matching existence guidance module (MEG)-Net, a Pl & uuml;cker line matching network guided by the existence of matches. It leverages the rich geometric characteristics of 3-D lines represented as Pl & uuml;cker lines, enhancing feature robustness. By guiding the model to handle the noisy data through match existence guidance, it improves the model's performance on partially overlapping 3-D line data. Experiments on the indoor and outdoor data sets and the Out of Distribution (OOD) data sets demonstrate that the MEG-Net outperforms traditional methods and baseline models in 3-D line matching, with better scalability and noise robustness, achieving state-of-the-art results. Additionally, we propose an innovative knowledge distillation method based on the matching matrices, training a more efficient MEG-Net mini student model with approximately 70% fewer parameters and multiply accumulate operations (MACs), while maintaining superior performance and faster inference speeds on the indoor data sets.
引用
收藏
页码:33418 / 33438
页数:21
相关论文
共 48 条
  • [1] LiDAR-Camera Calibration Using Line Correspondences
    Bai, Zixuan
    Jiang, Guang
    Xu, Ailing
    [J]. SENSORS, 2020, 20 (21) : 1 - 17
  • [2] BESL PJ, 1992, P SOC PHOTO-OPT INS, V1611, P586, DOI 10.1117/12.57955
  • [3] The EuRoC micro aerial vehicle datasets
    Burri, Michael
    Nikolic, Janosch
    Gohl, Pascal
    Schneider, Thomas
    Rehder, Joern
    Omari, Sammy
    Achtelik, Markus W.
    Siegwart, Roland
    [J]. INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2016, 35 (10) : 1157 - 1163
  • [4] PCAM: Product of Cross-Attention Matrices for Rigid Registration of Point Clouds
    Cao, Anh-Quan
    Puy, Gilles
    Boulch, Alexandre
    Marlet, Renaud
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 13209 - 13218
  • [5] Indoor-Outdoor 3D Reconstruction Alignment
    Cohen, Andrea
    Schonberger, Johannes L.
    Speciale, Pablo
    Sattler, Torsten
    Frahm, Jan-Michael
    Pollefeys, Marc
    [J]. COMPUTER VISION - ECCV 2016, PT III, 2016, 9907 : 285 - 300
  • [6] Joint structured pruning and dense knowledge distillation for efficient transformer model compression
    Cui, Baiyun
    Li, Yingming
    Zhang, Zhongfei
    [J]. NEUROCOMPUTING, 2021, 458 : 56 - 69
  • [7] Dang Z, 2020, Arxiv, DOI arXiv:2006.04523
  • [8] A Robust RGB-D SLAM System With Points and Lines for Low Texture Indoor Environments
    Fu, Qiang
    Yu, Hongshan
    Lai, Lihai
    Wang, Jingwen
    Peng, Xia
    Sun, Wei
    Sun, Mingui
    [J]. IEEE SENSORS JOURNAL, 2019, 19 (21) : 9908 - 9920
  • [9] github.com, Lyken17: PyTorch-OpCounter: Count the MACs/FLOPs of your PyTorch model
  • [10] Grabner M, 2007, PROC CVPR IEEE, P200