RGB-D Inertial Odometry for a Resource-Restricted Robot in Dynamic Environments

被引:61
作者
Liu, Jianheng [1 ]
Li, Xuanfu [2 ]
Liu, Yueqian [1 ]
Chen, Haoyao [1 ]
机构
[1] Harbin Inst Technol Shenzhen, Sch Mech Engn & Automat, Shenzhen 518055, Guangdong, Peoples R China
[2] Huawei Technol Co Ltd, Dept HiSilicon Res, Shenzhen 518129, Guangdong, Peoples R China
基金
中国国家自然科学基金;
关键词
Localization; visual-inertial SLAM;
D O I
10.1109/LRA.2022.3191193
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Current simultaneous localization and mapping (SLAM) algorithms perform well in static environments but easily fail in dynamic environments. Recent works introduce deep learning-based semantic information to SLAM systems to reduce the influence of dynamic objects. However, it is still challenging to apply a robust localization in dynamic environments for resource-restricted robots. This paper proposes a real-time RGB-D inertial odometry system for resource-restricted robots in dynamic environments named Dynamic-VINS. Three main threads run in parallel: object detection, feature tracking, and state optimization. The proposed Dynamic-VINS combines object detection and depth information for dynamic feature recognition and achieves performance comparable to semantic segmentation. Dynamic-VINS adopts grid-based feature detection and proposes a fast and efficient method to extract high-quality FAST feature points. IMU is applied to predict motion for feature tracking and moving consistency check. The proposed method is evaluated on both public datasets and real-world applications and shows competitive localization accuracy and robustness in dynamic environments. Yet, to the best of our knowledge, it is the best-performance real-time RGB-D inertial odometry for resource-restricted platforms in dynamic environments for now. The proposed system is open source at: https://github.com/HITSZ-NRSL/Dynamic-VINS.git.
引用
收藏
页码:9573 / 9580
页数:8
相关论文
共 30 条
[1]  
[Anonymous], 2016, P EUR C COMP VIS, DOI DOI 10.1007/978-3-319-46448-0\_2
[2]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[3]   Stereo Visual Inertial Odometry for Robots with Limited Computational Resources [J].
Bahnam, Stavrow ;
Pfeiffer, Sven ;
de Croon, Guido C. H. E. .
2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, :9154-9159
[4]   DOT: Dynamic Object Tracking for Visual SLAM [J].
Ballester, Irene ;
Fontan, Alejandro ;
Civera, Javier ;
Strobl, Klaus H. ;
Triebel, Rudolph .
2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, :11705-11711
[5]   DynaSLAM: Tracking, Mapping, and Inpainting in Dynamic Scenes [J].
Bescos, Berta ;
Facil, Jose M. ;
Civera, Javier ;
Neira, Jose .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2018, 3 (04) :4076-4083
[6]   RGB-D SLAM in Dynamic Environments Using Point Correlations [J].
Dai, Weichen ;
Zhang, Yu ;
Li, Ping ;
Fang, Zheng ;
Scherer, Sebastian .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (01) :373-389
[7]   Direct Sparse Odometry [J].
Engel, Jakob ;
Koltun, Vladlen ;
Cremers, Daniel .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (03) :611-625
[8]   RANDOM SAMPLE CONSENSUS - A PARADIGM FOR MODEL-FITTING WITH APPLICATIONS TO IMAGE-ANALYSIS AND AUTOMATED CARTOGRAPHY [J].
FISCHLER, MA ;
BOLLES, RC .
COMMUNICATIONS OF THE ACM, 1981, 24 (06) :381-395
[9]  
Forster C, 2015, ROBOTICS: SCIENCE AND SYSTEMS XI
[10]  
Geneva P, 2020, IEEE INT CONF ROBOT, P4666, DOI [10.1109/ICRA40945.2020.9196524, 10.1109/icra40945.2020.9196524]