An improved multi-object classification algorithm for visual SLAM under dynamic environment

被引:7
|
作者
Wen, Shuhuan [1 ,2 ]
Liu, Xin [1 ,2 ]
Wang, Zhe [1 ,2 ]
Zhang, Hong [3 ]
Zhang, Zhishang [1 ,2 ]
Tian, Wenbo [1 ,2 ]
机构
[1] Yanshan Univ, Key Lab Ind Comp Control Engn Hebei Prov, Qinhuangdao, Hebei, Peoples R China
[2] Yanshan Univ, Engn Res Ctr, Minist Educ Intelligent Control Syst & Intelligen, Qinhuangdao, Hebei, Peoples R China
[3] Southern Univ Sci & Technol, Dept Elect & Elect Engn, Shenzhen, Peoples R China
基金
中国国家自然科学基金;
关键词
ORB-SLAM2; Multi-object classification; Reprojection error algorithm; Dynamic indoor environments;
D O I
10.1007/s11370-021-00400-8
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
In this paper, a novel dynamic multi-object classification method is proposed based on real-time localization of a robot equipped with a vision sensor that captures a sparse three-dimensional environment. Specifically, we build upon ORB-SLAM2 and improve its formulation to better handle moving objects in a dynamic environment. We propose a feature classification algorithm for ORB (oriented FAST and rotated BRIEF) features in complex environments. Based on inter-frame texture constraints, we add the reprojection error algorithm, which can reduce the influence of illumination and dynamic objects on the simultaneous localization and mapping (SLAM) algorithm. We then propose a new dynamic initialization strategy and apply the proposed feature classification algorithm to the ORB-SLAM2 tracking thread. For real-world implementations, we focus on the robustness and real-time performance of dynamic target segmentation simultaneously, which cannot be satisfied by existing geometric segmentation and semantic segmentation methods. From an engineering point of view, the proposed work can quickly separate dynamic feature points based on traditional methods, which makes the proposed algorithm has better real time in practical applications. We thoroughly evaluate our approach on the TUM and KITTI benchmark database and on a real environment using the Turtlebot platform equipped with a Bumblebee camera. The experimental results indicate that the proposed method is more robust and accurate than current state-of-the-art methods in different environments.
引用
收藏
页码:39 / 55
页数:17
相关论文
共 50 条
  • [41] A Distributed Solution for Multi-Object Tracking and Classification
    Hachour, Samir
    Delmotte, Francois
    Mercier, David
    2014 17TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), 2014,
  • [42] DynaSLAM II: Tightly-Coupled Multi-Object Tracking and SLAM
    Bescos, Berta
    Campos, Carlos
    Tardos, Juan D.
    Neira, Jose
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (03) : 5191 - 5198
  • [43] Visual SLAM Based on the Improved RANSAC Algorithm
    Xu Y.
    An W.
    Tianjin Daxue Xuebao (Ziran Kexue yu Gongcheng Jishu Ban)/Journal of Tianjin University Science and Technology, 2020, 53 (10): : 1069 - 1076
  • [44] Interactive routing algorithm for multi-object optimization
    Wang, Ze-Yan
    Wang, Ting-Chang
    Xitong Fangzhen Xuebao / Journal of System Simulation, 2003, 15 (09):
  • [45] A Robust Visual SLAM System in Dynamic Environment
    Ma, Huajun
    Qin, Yijun
    Duan, Shukai
    Wang, Lidan
    ADVANCES IN NEURAL NETWORKS-ISNN 2024, 2024, 14827 : 248 - 257
  • [46] Improved ant colony optimization algorithm for multi-object routing in wireless sensor networks
    Liu, Xuxun
    Cao, Yang
    Zou, Xueyu
    Zhang, Jin
    Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2007, 35 (10): : 24 - 27
  • [47] An Improved Visual SLAM Based on Map Point Reliability under Dynamic Environments
    Ni, Jianjun
    Wang, Li
    Wang, Xiaotian
    Tang, Guangyi
    APPLIED SCIENCES-BASEL, 2023, 13 (04):
  • [48] Personnel Monitoring in Shipboard Surveillance Using Improved Multi-Object Detection and Tracking Algorithm
    Li, Yiming
    Zhang, Bin
    Liu, Yichen
    Wang, Huibing
    Zhang, Shibo
    SENSORS, 2024, 24 (17)
  • [49] Improved Multi-object Tracking Algorithm for Forward Looking Sonar Based on Rotation Estimation
    Ye, Xiufen
    Ma, Xinglong
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2019, PT II, 2019, 11741 : 171 - 183
  • [50] Visual SLAM Based on Lightweight Dynamic Object Detection
    Jiang, Changjiang
    Lin, Tong
    Tan, Li
    Zhao, Changhao
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 1158 - 1163