DFS-SLAM: A Visual SLAM Algorithm for Deep Fusion of Semantic Information

被引:1
|
作者
Jiao, Songming [1 ,2 ]
Li, Yan [2 ]
Shan, Zhengwen [2 ]
机构
[1] Hebei Technol Innovat Ctr Simulat & Optimized Cont, Baoding 071003, Peoples R China
[2] Univ North China Elect Power Univ, Sch Control & Comp Engn, Automat Dept, Baoding 071003, Peoples R China
来源
关键词
Semantics; Simultaneous localization and mapping; Dynamics; Vehicle dynamics; Heuristic algorithms; Accuracy; Semantic segmentation; Cameras; Optimization; Robots; SLAM; localization; recognition; deep learning for visual perception; SIMULTANEOUS LOCALIZATION; ROBUST;
D O I
10.1109/LRA.2024.3498773
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
In order to solve issues such as low accuracy, poor robustness and tracking loss in dynamic environments in traditional Simultaneous Localization and Mapping (SLAM) techniques, a semantic SLAM system named DFS-SLAM (Deep Fusion Semantics SLAM) is proposed. The algorithmic framework of DFS-SLAM is heavily inspired by ORB-SLAM2 and is robust in dynamic environments. In this letter, The DFS-SLAM proposed in this letter deeply integrates the semantic segmentation network and geometric method to effectively reduce the impact of dynamic objects on map construction. Meanwhile, a static point optimization method is proposed to improve the camera posture by using the semantic information of static objects, which effectively compensates for the loss of features after eliminating dynamic objects. The validation results on the TUM dataset show that DFS-SLAM has high accuracy and robustness in dynamic environments. In highly dynamic environments, DFS-SLAM shows a significant improvement in mapping accuracy compared to the ORB-SLAM2 algorithm. In most scenarios, it outperforms similar semantic SLAM algorithms such as DS-SLAM and DynaSLAM in accuracy as well.
引用
收藏
页码:11794 / 11801
页数:8
相关论文
共 50 条
  • [1] VIS-SLAM: A Real-Time Dynamic SLAM Algorithm Based on the Fusion of Visual, Inertial, and Semantic Information
    Wang, Yinglong
    Liu, Xiaoxiong
    Zhao, Minkun
    Xu, Xinlong
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2024, 13 (05)
  • [2] Visual SLAM algorithm based on semantic information and geometric consistency
    Lian, Jing
    Chen, Shi
    Pi, Jiahao
    Li, Linhui
    Li, Qingfeng
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 45 (06) : 10901 - 10919
  • [3] SaD-SLAM: A Visual SLAM Based on Semantic and Depth Information
    Yuan, Xun
    Chen, Song
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 4930 - 4935
  • [4] BY-SLAM: Dynamic Visual SLAM System Based on BEBLID and Semantic Information Extraction
    Zhu, Daixian
    Liu, Peixuan
    Qiu, Qiang
    Wei, Jiaxin
    Gong, Ruolin
    SENSORS, 2024, 24 (14)
  • [5] SIA-SLAM: a robust visual SLAM associated with semantic information in dynamic environments
    Liu, Qiang
    Yuan, Jie
    Kuang, Benfa
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (18) : 53531 - 53547
  • [6] SIA-SLAM: a robust visual SLAM associated with semantic information in dynamic environments
    Qiang Liu
    Jie Yuan
    Benfa Kuang
    Multimedia Tools and Applications, 2024, 83 : 53531 - 53547
  • [7] DMS-SLAM: semantic visual SLAM based on deep mask segmentation in dynamic environments
    Gao, Shuyuan
    Zhang, Minhui
    Gao, Xicheng
    Zhang, Dawei
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (04)
  • [8] SOF-SLAM: A Semantic Visual SLAM for Dynamic Environments
    Cui, Linyan
    Ma, Chaowei
    IEEE ACCESS, 2019, 7 : 166528 - 166539
  • [9] Visual SLAM Integration With Semantic Segmentation and Deep Learning: A Review
    Pu, Huayan
    Luo, Jun
    Wang, Gang
    Huang, Tao
    Liu, Hongliang
    Luo, Jun
    IEEE SENSORS JOURNAL, 2023, 23 (19) : 22119 - 22138
  • [10] Research progress in the application of image semantic information in visual SLAM
    Guo, Chi
    Liu, Yang
    Luo, Yarong
    Liu, Jingnan
    Zhang, Quan
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2024, 53 (06): : 1057 - 1076