DMN-SLAM: Multi-MLPs Neural Implicit Representation SLAM for Dynamic Environments

被引:1
作者
Lian, Xiaofeng [1 ]
Kang, Maomao [1 ]
Sun, Xiao [1 ]
Tan, Li [1 ]
Liu, He [2 ]
机构
[1] Beijing Technol & Business Univ, Sch Comp & Artificial Intelligence, Beijing 100048, Peoples R China
[2] Chongqing Acad Educ Sci, Chongqing 400015, Peoples R China
来源
IEEE ACCESS | 2025年 / 13卷
关键词
Simultaneous localization and mapping; Image color analysis; Decoding; Feature extraction; Cameras; Vehicle dynamics; Neural radiance field; Accuracy; Three-dimensional displays; Heuristic algorithms; Neural radiance fields (NeRF); simultaneous localization and mapping (SLAM); semantic segmentation; i-octree; dynamic environments;
D O I
10.1109/ACCESS.2025.3540585
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Addressing the limitations of traditional V-SLAM in large-scale and dynamic environments, this paper proposes a multi-MLPs neural implicit representation SLAM in Dynamic Environments(DMN-SLAM), which leverages neural radiance fields to facilitate local mapping in dynamic scenes. This system aims to achieve high-fidelity 3D scene reconstruction, making it suitable for real-world autonomous driving applications. Specifically, the proposed DMN-SLAM system includes a pre-processing semantic segmentation module that processes the scene to eliminate dynamic objects, thereby reducing their impact on SLAM localization and mapping. In the tracking module, a traditional feature-based visual odometry module is employed to estimate poses, enhancing tracking accuracy. In the mapping module, five different MLP neural implicit encoding structures are implemented to efficiently extract and represent detailed features of the scene, enabling local updates and optimization. Finally, a dynamic and efficient octree structure is introduced to store voxel features. This structure not only significantly reduces storage requirements but also allows for rapid querying and updating of map points, further enhancing the performance and practicality of system. Experimental results demonstrate that the proposed method achieves high reconstruction accuracy and quality without the need for pretraining. DMN-SLAM outperforms other neural radiance field SLAM methods in terms of tracking accuracy and mapping quality in dynamic environments.
引用
收藏
页码:29432 / 29444
页数:13
相关论文
共 38 条
[1]   DDL-SLAM: A Robust RGB-D SLAM in Dynamic Environments Combined With Deep Learning [J].
Ai, Yongbao ;
Rui, Ting ;
Lu, Ming ;
Fu, Lei ;
Liu, Shuai ;
Wang, Song .
IEEE ACCESS, 2020, 8 :162335-162342
[2]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[3]   DynaSLAM: Tracking, Mapping, and Inpainting in Dynamic Scenes [J].
Bescos, Berta ;
Facil, Jose M. ;
Civera, Javier ;
Neira, Jose .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2018, 3 (04) :4076-4083
[4]   ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial, and Multimap SLAM [J].
Campos, Carlos ;
Elvira, Richard ;
Gomez Rodriguez, Juan J. ;
Montiel, Jose M. M. ;
Tardos, Juan D. .
IEEE TRANSACTIONS ON ROBOTICS, 2021, 37 (06) :1874-1890
[5]   Improving Dense Mapping for Mobile Robots in Dynamic Environments Based on Semantic Information [J].
Cheng, Jiyu ;
Wang, Chaoqun ;
Mai, Xiaochun ;
Min, Zhe ;
Meng, Max Q. -H. .
IEEE SENSORS JOURNAL, 2021, 21 (10) :11740-11747
[6]   DM-SLAM: A Feature-Based SLAM System for Rigid Dynamic Scenes [J].
Cheng, Junhao ;
Wang, Zhi ;
Zhou, Hongyan ;
Li, Li ;
Yao, Jian .
ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2020, 9 (04)
[7]   Orbeez-SLAM: A Real-time Monocular Visual SLAM with ORB Features and NeRF-realized Mapping [J].
Chung, Chi-Ming ;
Tseng, Yang-Che ;
Hsu, Ya-Ching ;
Shi, Xiang-Qian ;
Hua, Yun-Hung ;
Yeh, Jia-Fong ;
Chen, Wen-Chin ;
Chen, Yi-Ting ;
Hsu, Winston H. .
2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2023), 2023, :9400-9406
[8]   Direct Sparse Odometry [J].
Engel, Jakob ;
Koltun, Vladlen ;
Cremers, Daniel .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (03) :611-625
[9]   LSD-SLAM: Large-Scale Direct Monocular SLAM [J].
Engel, Jakob ;
Schoeps, Thomas ;
Cremers, Daniel .
COMPUTER VISION - ECCV 2014, PT II, 2014, 8690 :834-849
[10]   MLC-SLAM: MASK LOOP CLOSING FOR MONOCULAR SLAM [J].
Han, Bo ;
Xu, Li .
INTERNATIONAL JOURNAL OF ROBOTICS & AUTOMATION, 2022, 37 (01) :107-114