SALSA: Swift Adaptive Lightweight Self-Attention for Enhanced LiDAR Place Recognition

被引:1
作者
Goswami, Raktim Gautam [1 ]
Patel, Naman [1 ]
Krishnamurthy, Prashanth [1 ]
Khorrami, Farshad [1 ]
机构
[1] NYU Tandon Sch Engn, Dept Elect & Comp Engn, Control Robot Res Lab CRRL, Brooklyn, NY 11201 USA
来源
IEEE ROBOTICS AND AUTOMATION LETTERS | 2024年 / 9卷 / 10期
关键词
Point cloud compression; Laser radar; Feature extraction; Location awareness; Mixers; Transformers; Deep learning; Deep learning for visual perception; deep learning methods; localization; representation learning;
D O I
10.1109/LRA.2024.3440098
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Large-scale LiDAR mappings and localization leverage place recognition techniques to mitigate odometry drifts, ensuring accurate mapping. These techniques utilize scene representations from LiDAR point clouds to identify previously visited sites within a database. Local descriptors, assigned to each point within a point cloud, are aggregated to form a scene representation for the point cloud. These descriptors are also used to re-rank the retrieved point clouds based on geometric fitness scores. We propose SALSA, a novel, lightweight, and efficient framework for LiDAR place recognition. It consists of a Sphereformer backbone that uses radial window attention to enable information aggregation for sparse distant points, an adaptive self-attention layer to pool local descriptors into tokens, and a multi-layer-perceptron Mixer layer for aggregating the tokens to generate a scene descriptor. The proposed framework outperforms existing methods on various LiDAR place recognition datasets in terms of both retrieval and metric localization while operating in real-time.
引用
收藏
页码:8242 / 8249
页数:8
相关论文
共 50 条
  • [21] EEG-Based Emotion Recognition With Emotion Localization via Hierarchical Self-Attention
    Zhang, Yuzhe
    Liu, Huan
    Zhang, Dalin
    Chen, Xuxu
    Qin, Tao
    Zheng, Qinghua
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (03) : 2458 - 2469
  • [22] An Intelligent Point Cloud Recognition Method for Substation Equipment Based on Multiscale Self-Attention
    Shen, Xiaojun
    Xu, Zelin
    Wang, Mei
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [23] Cross Hyperspectral and LiDAR Attention Transformer: An Extended Self-Attention for Land Use and Land Cover Classification
    Roy, Swalpa Kumar
    Sukul, Atri
    Jamali, Ali
    Haut, Juan M.
    Ghamisi, Pedram
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 15
  • [24] SELF-ATTENTION BASED DARKNET NAMED ENTITY RECOGNITION WITH BERT METHODS
    Chen, Yuxuan
    Guo, Yubin
    Jiang, Hong
    Ding, Jianwei
    Chen, Zhouguo
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2021, 17 (06): : 1973 - 1988
  • [25] Squeeze-and-Excitation Self-Attention Mechanism Enhanced Digital Audio Source Recognition Based on Transfer Learning
    Zeng, Chunyan
    Zhao, Yuhao
    Wang, Zhifeng
    Li, Kun
    Wan, Xiangkui
    Liu, Min
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2025, 44 (01) : 480 - 512
  • [26] Self-Attention Networks for Human Activity Recognition Using Wearable Devices
    Betancourt, Carlos
    Chen, Wen-Hui
    Kuan, Chi-Wei
    2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 1194 - 1199
  • [27] Human Activity Recognition Based on Self-Attention Mechanism in WiFi Environment
    Ge, Fei
    Yang, Zhimin
    Dai, Zhenyang
    Tan, Liansheng
    Hu, Jianyuan
    Li, Jiayuan
    Qiu, Han
    IEEE ACCESS, 2024, 12 : 85231 - 85243
  • [28] A framework for facial expression recognition using deep self-attention network
    Indolia S.
    Nigam S.
    Singh R.
    Journal of Ambient Intelligence and Humanized Computing, 2023, 14 (07) : 9543 - 9562
  • [29] Adaptive Feature Self-Attention in Spiking Neural Networks for Hyperspectral Classification
    Li, Heng
    Tu, Bing
    Liu, Bo
    Li, Jun
    Plaza, Antonio
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [30] Relational Reasoning for Group Activity Recognition via Self-Attention Augmented Conditional Random Field
    Pramono, Rizard Renanda Adhi
    Fang, Wen-Hsien
    Chen, Yie-Tarng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 8184 - 8199