Improved Multi-Sensor Fusion Dynamic Odometry Based on Neural Networks

被引:2
|
作者
Luo, Lishu [1 ]
Peng, Fulun [1 ]
Dong, Longhui [1 ]
机构
[1] Xian Inst Appl Opt, Xian 710065, Peoples R China
关键词
simultaneous localization and mapping (SLAM); multi-sensor fusion; dynamic elimination; REAL-TIME; ROBUST;
D O I
10.3390/s24196193
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
High-precision simultaneous localization and mapping (SLAM) in dynamic real-world environments plays a crucial role in autonomous robot navigation, self-driving cars, and drone control. To address this dynamic localization issue, in this paper, a dynamic odometry method is proposed based on FAST-LIVO, a fast LiDAR (light detection and ranging)-inertial-visual odometry system, integrating neural networks with laser, camera, and inertial measurement unit modalities. The method first constructs visual-inertial and LiDAR-inertial odometry subsystems. Then, a lightweight neural network is used to remove dynamic elements from the visual part, and dynamic clustering is applied to the LiDAR part to eliminate dynamic environments, ensuring the reliability of the remaining environmental data. Validation of the datasets shows that the proposed multi-sensor fusion dynamic odometry can achieve high-precision pose estimation in complex dynamic environments with high continuity, reliability, and dynamic robustness.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Multi-sensor Data Fusion Based on Dynamic Fuzzy Neural Network
    Xiao, Yang
    Cao, Zhiguo
    Zheng, Yi
    Yan, Ruicheng
    2008 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-8, 2008, : 3590 - 3594
  • [2] Multi-sensor data fusion for sign language recognition based on dynamic Bayesian networks and convolution neural networks
    Zhao, Y. D.
    Xiao, Q. K.
    Wang, H.
    AUTOMATIC CONTROL, MECHATRONICS AND INDUSTRIAL ENGINEERING, 2019, : 329 - 336
  • [3] Multi-sensor information fusion method based on dynamic Bayesian networks
    Mu, Rong-Jun
    Han, Peng-Xin
    Cui, Nai-Gang
    Kongzhi yu Juece/Control and Decision, 2009, 24 (09): : 1340 - 1344
  • [4] Active and Dynamic Multi-sensor Information Fusion Method Based on Dynamic Bayesian Networks
    Han, Pengxin
    Mu, Rongjun
    Cui, Naigang
    2009 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION, VOLS 1-7, CONFERENCE PROCEEDINGS, 2009, : 3076 - 3080
  • [5] Application of multi-sensor fusion localization algorithm based on recurrent neural networks
    Huang, Zexia
    Ye, Guoyang
    Yang, Pu
    Yu, Wanshun
    SCIENTIFIC REPORTS, 2025, 15 (01):
  • [6] A Multi-Sensor Fusion Framework Based on Coupled Residual Convolutional Neural Networks
    Li, Hao
    Ghamisi, Pedram
    Rasti, Behnood
    Wu, Zhaoyan
    Shapiro, Aurelie
    Schultz, Michael
    Zipf, Alexander
    REMOTE SENSING, 2020, 12 (12)
  • [7] Swallow segmentation with artificial neural networks and multi-sensor fusion
    Lee, Joon
    Steele, Catriona M.
    Chau, Tom
    MEDICAL ENGINEERING & PHYSICS, 2009, 31 (09) : 1049 - 1055
  • [8] The equivalence of Bayesian multi-sensor information fusion and neural networks
    Aarabi, P
    SENSOR FUSION: ARCHITECTURES, ALGORITHMS AND APPLICATIONS V, 2001, 4385 : 67 - 76
  • [9] Environment-aware Strategy for Multi-sensor Fusion Based on Improved YOLO Networks
    Zhao, Zhanfeng
    Su, Huiying
    Sun, Mengzhe
    2024 8TH INTERNATIONAL CONFERENCE ON IMAGING, SIGNAL PROCESSING AND COMMUNICATIONS, ICISPC 2024, 2024, : 156 - 164
  • [10] Dynamic obstacle detection based on multi-sensor information fusion
    Liu Meichen
    Chen Jun
    Zhao Xiang
    Wang Lu
    Tian Yongpeng
    IFAC PAPERSONLINE, 2018, 51 (17): : 861 - 865