Patchlpr: a multi-level feature fusion transformer network for LiDAR-based place recognition

被引:0
|
作者
Sun, Yang [1 ,2 ]
Guo, Jianhua [1 ,3 ]
Wang, Haiyang [4 ]
Zhang, Yuhang [1 ,3 ]
Zheng, Jiushuai [1 ,3 ]
Tian, Bin [5 ]
机构
[1] Hebei Univ Engn, Coll Mech & Equipment Engn, Handan 056038, Peoples R China
[2] Key Lab Intelligent Ind Equipment Technol Hebei Pr, Handan, Hebei, Peoples R China
[3] Handan Key Lab Intelligent Vehicles, Handan, Hebei, Peoples R China
[4] Jizhong Energy Fengfeng Grp Co Ltd, 16 Unicom South Rd, Handan, Hebei, Peoples R China
[5] Chinese Acad Sci, Inst Automat, Beijing, Peoples R China
关键词
SLAM; LiDAR Place recognition; Deep learning; Patch; VISION; DEEP;
D O I
10.1007/s11760-024-03138-9
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
LiDAR-based place recognition plays a crucial role in autonomous vehicles, enabling the identification of locations in GPS-invalid environments that were previously accessed. Localization in place recognition can be achieved by searching for nearest neighbors in the database. Two common types of place recognition features are local descriptors and global descriptors. Local descriptors typically compactly represent regions or points, while global descriptors provide an overarching view of the data. Despite the significant progress made in recent years by both types of descriptors, any representation inevitably involves information loss. To overcome this limitation, we have developed PatchLPR, a Transformer network employing multi-level feature fusion for robust place recognition. PatchLPR integrates global and local feature information, focusing on meaningful regions on the feature map to generate an environmental representation. We propose a patch feature extraction module based on the Vision Transformer to fully leverage the information and correlations of different features. We evaluated our approach on the KITTI dataset and a self-collected dataset covering over 4.2 km. The experimental results demonstrate that our method effectively utilizes multi-level features to enhance place recognition performance.
引用
收藏
页码:157 / 165
页数:9
相关论文
共 50 条
  • [31] A Mutual Guidance Attention-Based Multi-Level Fusion Network for Hyperspectral and LiDAR Classification
    Zhang, Tongzhen
    Xiao, Song
    Dong, Wenqian
    Qu, Jiahui
    Yang, Yufei
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [32] Multi-Level Transformer-Based Social Relation Recognition
    Wang, Yuchen
    Qing, Linbo
    Wang, Zhengyong
    Cheng, Yongqiang
    Peng, Yonghong
    SENSORS, 2022, 22 (15)
  • [33] A Multi-level spatial feature fusion-based transformer for intelligent defect recognition with small samples toward smart manufacturing system
    Gao, Yiping
    Li, Xinyu
    Gao, Liang
    INTERNATIONAL JOURNAL OF COMPUTER INTEGRATED MANUFACTURING, 2024, 37 (1-2) : 4 - 17
  • [34] LiDAR-Based Semantic Place Recognition in Dynamic Urban Environments
    Wei, Kun
    Ni, Peizhou
    Li, Xu
    Hu, Yue
    Hu, Weiming
    IEEE SENSORS JOURNAL, 2024, 24 (17) : 28397 - 28408
  • [35] Expression invariant face recognition based on multi-level feature fusion and transfer learning technique
    P. M. Ashok Kumar
    L. Arun Raj
    K. Martin Sagayam
    N. Sree Ram
    Multimedia Tools and Applications, 2022, 81 : 37183 - 37201
  • [36] MapsNet: Multi-level feature constraint and fusion network for change detection
    Pan, Jianping
    Cui, Wei
    An, Xinyong
    Huang, Xiao
    Zhang, Hanchao
    Zhang, Sihang
    Zhang, Ruiqian
    Li, Xin
    Cheng, Weihua
    Hu, Yong
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 108
  • [37] Traffic density estimation via a multi-level feature fusion network
    Ying-Xiang Hu
    Rui-Sheng Jia
    Yong-Chao Li
    Qi Zhang
    Hong-Mei Sun
    Applied Intelligence, 2022, 52 : 10417 - 10429
  • [38] MIFFuse: A Multi-Level Feature Fusion Network for Infrared and Visible Images
    Zhu D.
    Zhan W.
    Jiang Y.
    Xu X.
    Guo R.
    IEEE Access, 2021, 9 : 130778 - 130792
  • [39] Traffic density estimation via a multi-level feature fusion network
    Hu, Ying-Xiang
    Jia, Rui-Sheng
    Li, Yong-Chao
    Zhang, Qi
    Sun, Hong-Mei
    APPLIED INTELLIGENCE, 2022, 52 (09) : 10417 - 10429
  • [40] Visual Place Recognition based on Multi-level CNN Features
    Bao, Zhenqiang
    Li, Aihua
    Cui, Zhigao
    Zhang, Jinming
    PROCEEDINGS OF ICRCA 2018: 2018 THE 3RD INTERNATIONAL CONFERENCE ON ROBOTICS, CONTROL AND AUTOMATION / ICRMV 2018: 2018 THE 3RD INTERNATIONAL CONFERENCE ON ROBOTICS AND MACHINE VISION, 2018, : 202 - 207