DMN-SLAM: Multi-MLPs Neural Implicit Representation SLAM for Dynamic Environments

被引:1
作者
Lian, Xiaofeng [1 ]
Kang, Maomao [1 ]
Sun, Xiao [1 ]
Tan, Li [1 ]
Liu, He [2 ]
机构
[1] Beijing Technol & Business Univ, Sch Comp & Artificial Intelligence, Beijing 100048, Peoples R China
[2] Chongqing Acad Educ Sci, Chongqing 400015, Peoples R China
来源
IEEE ACCESS | 2025年 / 13卷
关键词
Simultaneous localization and mapping; Image color analysis; Decoding; Feature extraction; Cameras; Vehicle dynamics; Neural radiance field; Accuracy; Three-dimensional displays; Heuristic algorithms; Neural radiance fields (NeRF); simultaneous localization and mapping (SLAM); semantic segmentation; i-octree; dynamic environments;
D O I
10.1109/ACCESS.2025.3540585
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Addressing the limitations of traditional V-SLAM in large-scale and dynamic environments, this paper proposes a multi-MLPs neural implicit representation SLAM in Dynamic Environments(DMN-SLAM), which leverages neural radiance fields to facilitate local mapping in dynamic scenes. This system aims to achieve high-fidelity 3D scene reconstruction, making it suitable for real-world autonomous driving applications. Specifically, the proposed DMN-SLAM system includes a pre-processing semantic segmentation module that processes the scene to eliminate dynamic objects, thereby reducing their impact on SLAM localization and mapping. In the tracking module, a traditional feature-based visual odometry module is employed to estimate poses, enhancing tracking accuracy. In the mapping module, five different MLP neural implicit encoding structures are implemented to efficiently extract and represent detailed features of the scene, enabling local updates and optimization. Finally, a dynamic and efficient octree structure is introduced to store voxel features. This structure not only significantly reduces storage requirements but also allows for rapid querying and updating of map points, further enhancing the performance and practicality of system. Experimental results demonstrate that the proposed method achieves high reconstruction accuracy and quality without the need for pretraining. DMN-SLAM outperforms other neural radiance field SLAM methods in terms of tracking accuracy and mapping quality in dynamic environments.
引用
收藏
页码:29432 / 29444
页数:13
相关论文
共 38 条
[11]  
He KM, 2017, IEEE I CONF COMP VIS, P2980, DOI [10.1109/ICCV.2017.322, 10.1109/TPAMI.2018.2844175]
[12]   DI-Fusion: Online Implicit 3D Reconstruction with Deep Priors [J].
Huang, Jiahui ;
Huang, Shi-Sheng ;
Song, Haoxuan ;
Hu, Shi-Min .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :8928-8937
[13]   An Adaptive Visual Dynamic-SLAM Method Based on Fusing the Semantic Information [J].
Jiao, Jichao ;
Wang, Chenxu ;
Li, Ning ;
Deng, Zhongliang ;
Xu, Wei .
IEEE SENSORS JOURNAL, 2022, 22 (18) :17414-17420
[14]   DUNet: A deformable network for retinal vessel segmentation [J].
Jin, Qiangguo ;
Meng, Zhaopeng ;
Tuan D Pham ;
Chen, Qi ;
Wei, Leyi ;
Su, Ran .
KNOWLEDGE-BASED SYSTEMS, 2019, 178 :149-162
[15]   ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fields [J].
Johari, Mohammad Mahdi ;
Carta, Camilla ;
Fleuret, Francois .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, :17408-17419
[16]   End-to-End RGB-D SLAM With Multi-MLPs Dense Neural Implicit Representations [J].
Li, Mingrui ;
He, Jiaming ;
Wang, Yangyang ;
Wang, Hongyu .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (11) :7138-7145
[17]   SSD: Single Shot MultiBox Detector [J].
Liu, Wei ;
Anguelov, Dragomir ;
Erhan, Dumitru ;
Szegedy, Christian ;
Reed, Scott ;
Fu, Cheng-Yang ;
Berg, Alexander C. .
COMPUTER VISION - ECCV 2016, PT I, 2016, 9905 :21-37
[18]   NGEL-SLAM: Neural Implicit Representation-based Global Consistent Low-Latency SLAM System [J].
Mao, Yunxuan ;
Yu, Xuan ;
Zhang, Zhuqing ;
Wang, Kai ;
Wang, Yue ;
Xiong, Rong ;
Liao, Yiyi .
2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2024, 2024, :6952-6958
[19]   iMODE:Real-Time Incremental Monocular Dense Mapping Using Neural Field [J].
Matsuki, Hidenobu ;
Sucar, Edgar ;
Laidow, Tristan ;
Wada, Kentaro ;
Scona, Raluca ;
Davison, Andrew J. .
2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, :4171-4177
[20]  
Mildenhall B, 2022, COMMUN ACM, V65, P99, DOI 10.1145/3503250