SeqOT: A SpatialTemporal Transformer Network for Place Recognition Using Sequential LiDAR Data

被引:32
作者
Ma, Junyi [1 ]
Chen, Xieyuanli [2 ]
Xu, Jingyi [1 ]
Xiong, Guangming [1 ]
机构
[1] Beijing Inst Technol, Beijing 100811, Peoples R China
[2] Natl Univ Def Technol, Changsha 410073, Peoples R China
关键词
Laser radar; Transformers; Feature extraction; Image recognition; Fuses; Location awareness; Point cloud compression; Deep learning methods; LiDAR place recognition; sequence matching;
D O I
10.1109/TIE.2022.3229385
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Place recognition is an important component for autonomous vehicles to achieve loop closing or global localization. In this article, we tackle the problem of place recognition based on sequential 3-D LiDAR scans obtained by an onboard LiDAR sensor. We propose a transformer-based network named SeqOT to exploit the temporal and spatial information provided by sequential range images generated from the LiDAR data. It uses multiscale transformers to generate a global descriptor for each sequence of LiDAR range images in an end-to-end fashion. During online operation, our SeqOT finds similar places by matching such descriptors between the current query sequence and those stored in the map. We evaluate our approach on four datasets collected with different types of LiDAR sensors in different environments. The experimental results show that our method outperforms the state-of-the-art LiDAR-based place recognition methods and generalizes well across different environments. Furthermore, our method operates online faster than the frame rate of the sensor.
引用
收藏
页码:8225 / 8234
页数:10
相关论文
共 44 条
[1]  
Arandjelovic R, 2018, IEEE T PATTERN ANAL, V40, P1437, DOI [10.1109/TPAMI.2017.2711011, 10.1109/CVPR.2016.572]
[2]   An End-to-End Localizer for Long-Term Topological Localization in Large-Scale Changing Environments [J].
Cao, Fengkui ;
Wu, Hao ;
Wu, Chengdong .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2023, 70 (05) :5140-5149
[3]   Season-Invariant and Viewpoint-Tolerant LiDAR Place Recognition in GPS-Denied Environments [J].
Cao, Fengkui ;
Yan, Fei ;
Wang, Sen ;
Zhuang, Yan ;
Wang, Wei .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2021, 68 (01) :563-574
[4]   University of Michigan North Campus long-term vision and lidar dataset [J].
Carlevaris-Bianco, Nicholas ;
Ushani, Arash K. ;
Eustice, Ryan M. .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2016, 35 (09) :1023-1035
[5]  
Chen XYL, 2020, ROBOTICS: SCIENCE AND SYSTEMS XVI
[6]   Range Image-based LiDAR Localization for Autonomous Vehicles [J].
Chen, Xieyuanli ;
Vizzo, Ignacio ;
Labe, Thomas ;
Behley, Jens ;
Stachniss, Cyrill .
2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, :5802-5808
[7]   OverlapNet: a siamese network for computing LiDAR scan similarity with applications to loop closing and localization [J].
Chen, Xieyuanli ;
Laebe, Thomas ;
Milioto, Andres ;
Rohling, Timo ;
Behley, Jens ;
Stachniss, Cyrill .
AUTONOMOUS ROBOTS, 2022, 46 (01) :61-81
[8]   Learning an Overlap-based Observation Model for 3D LiDAR Localization [J].
Chen, Xieyuanli ;
Laebe, Thomas ;
Nardi, Lorenzo ;
Behley, Jens ;
Stachniss, Cyrill .
2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, :4602-4608
[9]  
Cop KP, 2018, IEEE INT CONF ROBOT, P3653, DOI 10.1109/ICRA.2018.8460940
[10]   Online Range Image-based Pole Extractor for Long-term LiDAR Localization in Urban Environments [J].
Dong, Hao ;
Chen, Xieyuanli ;
Stachniss, Cyrill .
10TH EUROPEAN CONFERENCE ON MOBILE ROBOTS (ECMR 2021), 2021,