Line Flow Based Simultaneous Localization and Mapping

被引:39
作者
Wang, Qiuyuan [1 ]
Yan, Zike [1 ]
Wang, Junqiu [2 ]
Xue, Fei [1 ]
Ma, Wei [3 ]
Zha, Hongbin [1 ]
机构
[1] Peking Univ, Key Lab Machine Percept, Minister Educ, Beijing 100871, Peoples R China
[2] AVIC, Beijing Changcheng Aeronaut Measurement & Control, Beijing 100176, Peoples R China
[3] Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
基金
中国国家自然科学基金;
关键词
Simultaneous localization and mapping; Image segmentation; Cameras; Motion segmentation; Image reconstruction; Optimization; Feature extraction; Line segment extraction and matching; simultaneous localization and mapping (SLAM); structure from motion (SfM); STRUCTURE-FROM-MOTION; SEGMENT DETECTOR; EFFICIENT; REPRESENTATION; GRAPH;
D O I
10.1109/TRO.2021.3061403
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
In this article, we propose a visual simultaneous localization and mapping (SLAM) method by predicting and updating line flows that represent sequential 2-D projections of 3-D line segments. While feature-based SLAM methods have achieved excellent results, they still face problems in challenging scenes containing occlusions, blurred images, and repetitive textures. To address these problems, we leverage a line flow to encode the coherence of line segment observations of the same 3-D line along the temporal dimension, which has been neglected in prior SLAM systems. Thanks to this line flow representation, line segments in a new frame can be predicted according to their corresponding 3-D lines and their predecessors along the temporal dimension. We create, update, merge, and discard line flows on-the-fly. We model the proposed line flow based SLAM (LF-SLAM) using a Bayesian network. Extensive experimental results demonstrate that the proposed LF-SLAM method achieves state-of-the-art results due to the utilization of line flows. Specifically, LF-SLAM obtains good localization and mapping results in challenging scenes with occlusions, blurred images, and repetitive textures.
引用
收藏
页码:1416 / 1432
页数:17
相关论文
共 47 条
[1]  
Agarwal S., 2012, Ceres solver
[2]   EDLines: A real-time line segment detector with a false detection control [J].
Akinlar, Cuneyt ;
Topal, Cihan .
PATTERN RECOGNITION LETTERS, 2011, 32 (13) :1633-1642
[3]   MCMLSD: A Dynamic Programming Approach to Line Segment Detection [J].
Almazan, Emilio J. ;
Tal, Ron ;
Qian, Yiming ;
Elder, James H. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5854-5862
[4]   EFFICIENT REGISTRATION OF STEREO IMAGES BY MATCHING GRAPH DESCRIPTIONS OF EDGE SEGMENTS [J].
AYACHE, N ;
FAVERJON, B .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1987, 1 (02) :107-131
[5]   GENERALIZING THE HOUGH TRANSFORM TO DETECT ARBITRARY SHAPES [J].
BALLARD, DH .
PATTERN RECOGNITION, 1981, 13 (02) :111-122
[6]   Structure-from-motion using lines: Representation, triangulation, and bundle adjustment [J].
Bartoli, A ;
Sturm, P .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2005, 100 (03) :416-441
[7]   The EuRoC micro aerial vehicle datasets [J].
Burri, Michael ;
Nikolic, Janosch ;
Gohl, Pascal ;
Schneider, Thomas ;
Rehder, Joern ;
Omari, Sammy ;
Achtelik, Markus W. ;
Siegwart, Roland .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2016, 35 (10) :1157-1163
[8]   A Novel Linelet-Based Representation for Line Segment Detection [J].
Cho, Nam-Gyu ;
Yuille, Alan ;
Lee, Seong-Whan .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (05) :1195-1208
[9]  
Dong RF, 2017, 2017 IEEE INTERNATIONAL CONFERENCE ON MULTISENSOR FUSION AND INTEGRATION FOR INTELLIGENT SYSTEMS (MFI), P494, DOI 10.1109/MFI.2017.8170369
[10]   Direct Sparse Odometry [J].
Engel, Jakob ;
Koltun, Vladlen ;
Cremers, Daniel .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (03) :611-625