SBC-SLAM: Semantic Bioinspired Collaborative SLAM for Large-Scale Environment Perception of Heterogeneous Systems

被引:2
作者
Liu, Dong [1 ]
Wu, Jingyuan [1 ]
Du, Yu [2 ]
Zhang, Runqi [1 ]
Cong, Ming [1 ]
机构
[1] Dalian Univ Technol, Sch Mech Engn, Dalian 116024, Peoples R China
[2] Dalian Jiaotong Univ, Sch Mech Engn, Dalian 116025, Peoples R China
关键词
Brain inspired simultaneous localization and mapping (SLAM); large-scale environment measurement; semantic metric map; view robust scene descriptor; visual SLAM; SPATIAL MAP; LOCALIZATION; CELLS; ROBOT; RATS;
D O I
10.1109/TIM.2024.3385825
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recently, there have been efforts to enable collaborative simultaneous localization and mapping (SLAM) of heterogeneous unmanned aerial vehicle (UAV)/unmanned ground vehicle (UGV) in large-scale dynamic environments. However, the challenges of collaborative localization introduced by the view differences between aerial and ground robots, high cost of storing, reusing the metric map, greatly limit the application of traditional visual SLAM algorithms in cross-domain robot collaborative SLAM. To address these issues, this article introduces a semantic-based bioinspired SLAM frame work for operating mobile robots equipped with a visual system in unstructured large-scale outdoor environments. This system forms a semidense semantic map through bioinspired tightly coupled visual inertial odometry, which can encode the sensory cues and self-motion cues with biological neural models in a compact and efficient manner. The topological information of semantic feature points serves as visually robust scene descriptor. It enables UAVs and UGVs to recognize the same scene with view variation. The proposed system is tested in both synthetic and real-world large-scale unstructured environments. Proposed system achieving a similar level of accuracy with about 20% of the key frame information required by traditional algorithms. It successfully registered heterogeneous robot's trajectory in both simulation and real environment, with errors under 10%. Its accuracy shows advantage to previous algorithms.
引用
收藏
页码:1 / 10
页数:10
相关论文
共 38 条
[1]  
Aggarwal A. K., 2020, J. Comput. Sci., V16, P651, DOI [10.3844/jcssp.2020.651.659, DOI 10.3844/JCSSP.2020.651.659]
[2]   Cooperative UAV-UGV Autonomous Power Pylon Inspection: An Investigation of Cooperative Outdoor Vehicle Positioning Architecture [J].
Cantieri, Alvaro ;
Ferraz, Matheus ;
Szekir, Guido ;
Teixeira, Marco Antonio ;
Lima, Jose ;
Oliveira, Andre Schneider ;
Wehrmeister, Marco Aurelio .
SENSORS, 2020, 20 (21) :1-22
[3]   Semantic Cross-View Matching [J].
Castaldo, Francesco ;
Zamir, Amir ;
Angst, Roland ;
Palmieri, Francesco ;
Savarese, Silvio .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOP (ICCVW), 2015, :1044-1052
[4]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[5]   Radiation search operations using scene understanding with autonomous UAV and UGV [J].
Christie, Gordon ;
Shoemaker, Adam ;
Kochersberger, Kevin ;
Tokekar, Pratap ;
McLean, Lance ;
Leonessa, Alexander .
JOURNAL OF FIELD ROBOTICS, 2017, 34 (08) :1450-1468
[6]   3D Semantic Map Construction Using Improved ORB-SLAM2 for Mobile Robot in Edge Computing Environment [J].
Cui, Xu ;
Lu, Chenggang ;
Wang, Jinxiang .
IEEE ACCESS, 2020, 8 :67179-67191
[7]   Bags of Binary Words for Fast Place Recognition in Image Sequences [J].
Galvez-Lopez, Dorian ;
Tardos, Juan D. .
IEEE TRANSACTIONS ON ROBOTICS, 2012, 28 (05) :1188-1197
[8]   X-View: Graph-Based Semantic Multiview Localization [J].
Gawel A. ;
Del Don C. ;
Siegwart R. ;
Nieto J. ;
Cadena C. .
IEEE Robotics and Automation Letters, 2018, 3 (03) :1687-1694
[9]   Semantic Histogram Based Graph Matching for Real-Time Multi-Robot Global Localization in Large Scale Environment [J].
Guo, Xiyue ;
Hu, Junjie ;
Chen, Junfeng ;
Deng, Fuqin ;
Lam, Tin Lun .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) :8349-8356
[10]   Microstructure of a spatial map in the entorhinal cortex [J].
Hafting, T ;
Fyhn, M ;
Molden, S ;
Moser, MB ;
Moser, EI .
NATURE, 2005, 436 (7052) :801-806