PL-SLAM: A Stereo SLAM System Through the Combination of Points and Line Segments

被引:393
作者
Gomez-Ojeda, Ruben [1 ]
Moreno, Francisco-Angel [1 ]
Zuniga-Noel, David [1 ]
Scaramuzza, Davide [2 ,3 ,4 ]
Gonzalez-Jimenez, Javier [1 ]
机构
[1] Univ Malaga, Machine Percept & Intelligent Robot Grp, Malaga 29016, Spain
[2] Univ Zurich, Dept Informat, Robot & Percept Grp, CH-8006 Zurich, Switzerland
[3] Univ Zurich, Dept Neuroinformat, CH-8092 Zurich, Switzerland
[4] Swiss Fed Inst Technol, CH-8092 Zurich, Switzerland
关键词
Bundle adjustment (BA); line segment features; loop closure; stereo visual simultaneous localization and mapping (SLAM); SIMULTANEOUS LOCALIZATION; PLACE RECOGNITION; VISUAL ODOMETRY; MAP; VISION;
D O I
10.1109/TRO.2019.2899783
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Traditional approaches to stereo visual simultaneous localization and mapping (SLAM) rely on point features to estimate the camera trajectory and build a map of the environment. In low-textured environments, though, it is often difficult to find a sufficient number of reliable point features and, as a consequence, the performance of such algorithms degrades. This paper proposes PL-SLAM, a stereo visual SLAM system that combines both points and line segments to work robustly in a wider variety of scenarios, particularly in those where point features are scarce or not well-distributed in the image. PL-SLAM leverages both points and line segments at all the instances of the process: visual odometry, keyframe selection, bundle adjustment, etc. We contribute also with a loop-closure procedure through a novel bag-of-words approach that exploits the combined descriptive power of the two kinds of features. Additionally, the resulting mapis richer and more diverse in three-dimensional elements, which can be exploited to infer valuable, high-level scene structures, such as planes, empty spaces, ground plane, etc. (not addressed in this paper). Our proposal has been tested with several popular datasets (such as EuRoC or KITTI), and is compared with state-of-the-art methods such as ORB-SLAM2, revealing a more robust performance in most of the experiments while still running in real time. An open-source version of the PL-SLAM C++ code has been released for the benefit of the community.
引用
收藏
页码:734 / 746
页数:13
相关论文
共 54 条
[41]   Visual Odometry Part I: The First 30 Years and Fundamentals [J].
Scaramuzza, Davide ;
Fraundorfer, Friedrich .
IEEE ROBOTICS & AUTOMATION MAGAZINE, 2011, 18 (04) :80-92
[42]  
Sibley D., 2009, Robotics: Science and Systems, V32, P33
[43]   Vast-scale Outdoor Navigation Using Adaptive Relative Bundle Adjustment [J].
Sibley, Gabe ;
Mei, Christopher ;
Reid, Ian ;
Newman, Paul .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2010, 29 (08) :958-980
[44]   The New College Vision and Laser Data Set [J].
Smith, Mike ;
Baldwin, Ian ;
Churchill, Winston ;
Paul, Rohan ;
Newman, Paul .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2009, 28 (05) :595-599
[45]  
Smith P., 2006, P BRIT MACH VIS C, P17, DOI 10.5244/C.20.3
[46]   Impact of Landmark Parametrization on Monocular EKF-SLAM with Points and Lines [J].
Sola, Joan ;
Vidal-Calleja, Teresa ;
Civera, Javier ;
Martinez Montiel, Jose Maria .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2012, 97 (03) :339-368
[47]   Undelayed initialization of line segments in monocular SLAM [J].
Sola, Joan ;
Vidal-Calleja, Teresa ;
Devy, Michel .
2009 IEEE-RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, 2009, :1553-1558
[48]  
Strasdat H, 2011, IEEE I CONF COMP VIS, P2352, DOI 10.1109/ICCV.2011.6126517
[49]  
Sturm J, 2012, IEEE INT C INT ROBOT, P573, DOI 10.1109/IROS.2012.6385773
[50]   LSD: A Fast Line Segment Detector with a False Detection Control [J].
von Gioi, Rafael Grompone ;
Jakubowicz, Jeremie ;
Morel, Jean-Michel ;
Randall, Gregory .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2010, 32 (04) :722-732