PL-SLAM: A Stereo SLAM System Through the Combination of Points and Line Segments

被引:393
作者
Gomez-Ojeda, Ruben [1 ]
Moreno, Francisco-Angel [1 ]
Zuniga-Noel, David [1 ]
Scaramuzza, Davide [2 ,3 ,4 ]
Gonzalez-Jimenez, Javier [1 ]
机构
[1] Univ Malaga, Machine Percept & Intelligent Robot Grp, Malaga 29016, Spain
[2] Univ Zurich, Dept Informat, Robot & Percept Grp, CH-8006 Zurich, Switzerland
[3] Univ Zurich, Dept Neuroinformat, CH-8092 Zurich, Switzerland
[4] Swiss Fed Inst Technol, CH-8092 Zurich, Switzerland
关键词
Bundle adjustment (BA); line segment features; loop closure; stereo visual simultaneous localization and mapping (SLAM); SIMULTANEOUS LOCALIZATION; PLACE RECOGNITION; VISUAL ODOMETRY; MAP; VISION;
D O I
10.1109/TRO.2019.2899783
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Traditional approaches to stereo visual simultaneous localization and mapping (SLAM) rely on point features to estimate the camera trajectory and build a map of the environment. In low-textured environments, though, it is often difficult to find a sufficient number of reliable point features and, as a consequence, the performance of such algorithms degrades. This paper proposes PL-SLAM, a stereo visual SLAM system that combines both points and line segments to work robustly in a wider variety of scenarios, particularly in those where point features are scarce or not well-distributed in the image. PL-SLAM leverages both points and line segments at all the instances of the process: visual odometry, keyframe selection, bundle adjustment, etc. We contribute also with a loop-closure procedure through a novel bag-of-words approach that exploits the combined descriptive power of the two kinds of features. Additionally, the resulting mapis richer and more diverse in three-dimensional elements, which can be exploited to infer valuable, high-level scene structures, such as planes, empty spaces, ground plane, etc. (not addressed in this paper). Our proposal has been tested with several popular datasets (such as EuRoC or KITTI), and is compared with state-of-the-art methods such as ORB-SLAM2, revealing a more robust performance in most of the experiments while still running in real time. An open-source version of the PL-SLAM C++ code has been released for the benefit of the community.
引用
收藏
页码:734 / 746
页数:13
相关论文
共 54 条
[1]   Structure-from-motion using lines: Representation, triangulation, and bundle adjustment [J].
Bartoli, A ;
Sturm, P .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2005, 100 (03) :416-441
[2]   The Malaga urban dataset: High-rate stereo and LiDAR in a realistic urban scenario [J].
Blanco-Claraco, Jose-Luis ;
Moreno-Duenas, Francisco-Angel ;
Gonzalez-Jimenez, Javier .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2014, 33 (02) :207-214
[3]   A Minimal Closed-form Solution for the Perspective Three Orthogonal Angles (P3oA) Problem: Application To Visual Odometry [J].
Briales, Jesus ;
Gonzalez-Jimenez, Javier .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2016, 55 (03) :266-283
[4]   The EuRoC micro aerial vehicle datasets [J].
Burri, Michael ;
Nikolic, Janosch ;
Gohl, Pascal ;
Schneider, Thomas ;
Rehder, Joern ;
Omari, Sammy ;
Achtelik, Markus W. ;
Siegwart, Roland .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2016, 35 (10) :1157-1163
[5]   Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age [J].
Cadena, Cesar ;
Carlone, Luca ;
Carrillo, Henry ;
Latif, Yasir ;
Scaramuzza, Davide ;
Neira, Jose ;
Reid, Ian ;
Leonard, John J. .
IEEE TRANSACTIONS ON ROBOTICS, 2016, 32 (06) :1309-1332
[6]  
Coughlan J. M., 1999, P IEEECVF INT C COMP, P941, DOI DOI 10.1109/ICCV.1999.790349
[7]   FAB-MAP: Probabilistic localization and mapping in the space of appearance [J].
Cummins, Mark ;
Newman, Paul .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2008, 27 (06) :647-665
[8]   Simultaneous localization and mapping: Part I [J].
Durrant-Whyte, Hugh ;
Bailey, Tim .
IEEE ROBOTICS & AUTOMATION MAGAZINE, 2006, 13 (02) :99-108
[9]   Edge landmarks in monocular SLAM [J].
Eade, Ethan ;
Drummond, Tom .
IMAGE AND VISION COMPUTING, 2009, 27 (05) :588-596
[10]   Direct Sparse Odometry [J].
Engel, Jakob ;
Koltun, Vladlen ;
Cremers, Daniel .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (03) :611-625