USD-SLAM: A Universal Visual SLAM Based on Large Segmentation Model in Dynamic Environments

被引：2
作者：
Wang, Jingwei [1 ]
Ren, Yizhang [2 ]
Li, Zhiwei [1 ]
Xie, Xiaoming [1 ]
Chen, Zilong [3 ]
Shen, Tianyu [1 ]
Liu, Huaping [3 ]
Wang, Kunfeng [1 ]
机构：
[1] Beijing Univ Chem Technol, Coll Informat Sci & Technol, Beijing 100029, Peoples R China
[2] Beihang Univ, Coll Instrumental Sci & Optoelect Engn, Beijing 100191, Peoples R China
[3] Tsinghua Univ, Dept Comp Sci & Technol, Beijing 100084, Peoples R China
来源：
IEEE ROBOTICS AND AUTOMATION LETTERS | 2024年 / 9卷 / 12期
基金：
中国国家自然科学基金;
关键词：
Image segmentation; Simultaneous localization and mapping; Dynamics; Three-dimensional displays; Motion segmentation; Semantics; Feature extraction; Vehicle dynamics; Location awareness; Cameras; SLAM; localization; object detection; segmentation and categorization; TRACKING;
D O I：
10.1109/LRA.2024.3498781
中图分类号：
TP24 [机器人技术];
学科分类号：
080202 ; 1405 ;
摘要：
Visual Simultaneous Localization and Mapping (SLAM) has been widely adopted in autonomous driving and robotics. While most SLAM systems operate effectively in static or low-dynamic environments, achieving precise pose estimation in diverse unknown dynamic environments continues to pose a significant challenge. This letter introduces an advanced universal visual SLAM system (USD-SLAM) that combines a universal large segmentation model with a 3D spatial motion state constraint module to accurately handle any dynamic objects present in the environment. Our system first employs a large segmentation model guided by precise prompts to identify movable regions accurately. Based on the identified movable object regions, 3D spatial motion state constraints are exploited to remove the moving object regions. Finally, the moving object regions are excluded for subsequent tracking, localization, and mapping, ensuring stable and high-precision pose estimation. Experimental results demonstrate that our method can robustly operate in various dynamic and static environments without additional training, providing higher localization accuracy compared to other advanced dynamic SLAM systems.
引用
收藏
页码：11810 / 11817
页数：8
相关论文
共 27 条
  • [1] Campos C., Elvira R., Rodr'Iguez J.J.G., Montiel J.M.M., Tardos J.D., Orb-SLAM3: An accurate open-source library for visual, visual-inertial, and multimap SLAM, IEEE Trans. Robot., 37, 6, pp. 1874-1890, (2021)
  • [2] Niculescu V., Polonelli T., Magno M., Benini L., NanoSLAM: Enabling fully onboard SLAM for tiny robots, IEEE Internet Things J., 11, 8, pp. 13584-13607, (2024)
  • [3] Zou Q., Sun Q., Chen L., Nie B., Li Q., A comparative analysis of LiDAR SLAM-based indoor navigation for autonomous vehicles, IEEE Trans. Intell. Transport. Syst., 23, 7, pp. 6907-6921, (2022)
  • [4] Song J., Wang J., Zhao L., Huang S., Dissanayake G., Mis-SLAM: Real-time large-scale dense deformable SLAMsystem in minimal invasive surgery based on heterogeneous computing, IEEE Robot. Automat. Lett., 3, 4, pp. 4068-4075, (2018)
  • [5] Mur-Artal R., Tardos J.D., Orb-SLAM2: An open-source SLAM system for monocular, stereo, and RGB-D cameras, IEEE Trans. Robot., 33, 5, pp. 1255-1262, (2017)
  • [6] Kaveti P., Vaidyanathan S.N., Chelvan A.T., Singh H., Design and evaluation of a generic visual SLAM framework for multi camera systems, IEEE Robot. Automat. Lett., 8, 11, pp. 7368-7375, (2023)
  • [7] Zhan H., Weerasekera C.S., Bian J., Reid I.D., Visual odometry revisited: What should be learnt?, Proc. 2020 IEEE Int. Conf. Robot. Automat., pp. 4203-4210, (2010)
  • [8] Bescos B., Facil J.M., Civera J., Neira J., DynaSLAM: Tracking, mapping, and inpainting in dynamic scenes, IEEE Robot. Automat. Lett., 3, 4, pp. 4076-4083, (2018)
  • [9] Yang L., Wang L., A semantic SLAM-based densemapping approach for large-scale dynamic outdoor environment, Measurement, 204, (2022)
  • [10] Kirillov A., Et al., Segment anything, Proc. 2023 IEEE/CVF Int. Conf. Comput. Vis., pp. 3992-4003, (2023)
123