An Improved Visual Odometer Based on Lucas-Kanade Optical Flow and ORB Feature

被引:5
作者
Zhong, Lingjun [1 ]
Meng, Limin [1 ]
Hou, Wei [1 ]
Huang, Li [2 ]
机构
[1] Zhejiang Univ Technol, Sch Informat Engn, Hangzhou 310000, Peoples R China
[2] Xinjiang Univ, Sch Elect Engn, Xinjiang 830000, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Optical flow; Information entropy; Odometers; Estimation; Lighting; Cameras; Entropy; LK optimal flow; motion estimation; CLAHE; information entropy; ORB;
D O I
10.1109/ACCESS.2023.3274784
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Visual odometer is an important part of SLAM system. Visual odometer based on feature points is the current mainstream. Featured based method completes the positioning by extracting feature points and matching descriptors. However, under low texture conditions, there are few features to extract, and the cost of matching descriptors is also high. to solve this problem, we propose a visual odometer based on Lucas-Kanade(LK) optical flow method and ORB feature. The method improves the performance of the ORB algorithm and acquires more feature points in a low-texture environment. A coarse-to-fine LK method is proposed for robustly and efficiently matching feature points between two frames. Based on this, a semi-direct visual odometry is proposed to improve the performance of visual odometry in low-texture environments. The main contribution of this method is that we introduce the direct method in the feature point-based approach, which significantly improves the localization accuracy in low-texture environments. The results show that the method can accomplish localization in low-texture environments without closed-loop. Experimental evaluation on two benchmark datasets shows that the method has higher accuracy and robustness in motion estimation compared to other state-of-the-art methods. We have done strict tests on EuRoC and TUM data sets, and the results show that our visual odometer has higher accuracy and robustness in low-texture environment than the state-of-art feature-based scheme.
引用
收藏
页码:47179 / 47186
页数:8
相关论文
共 26 条
[1]   Review of visual odometry: types, approaches, challenges, and applications [J].
Aqel, Mohammad O. A. ;
Marhaban, Mohammad H. ;
Saripan, M. Iqbal ;
Ismail, Napsiah Bt. .
SPRINGERPLUS, 2016, 5
[2]   Combining Fisheye Camera with Odometer for Autonomous Parking [J].
Bai, Donglin ;
Su, Jianbo .
NEURAL INFORMATION PROCESSING (ICONIP 2019), PT IV, 2019, 1142 :450-457
[3]   Semiparallel deep neural network hybrid architecture: first application on depth from monocular camera [J].
Bazrafkan, Shabab ;
Javidnia, Hossein ;
Lemley, Joseph ;
Corcoran, Peter .
JOURNAL OF ELECTRONIC IMAGING, 2018, 27 (04)
[4]   BRIEF: Binary Robust Independent Elementary Features [J].
Calonder, Michael ;
Lepetit, Vincent ;
Strecha, Christoph ;
Fua, Pascal .
COMPUTER VISION-ECCV 2010, PT IV, 2010, 6314 :778-792
[5]  
Cieslewski T, 2019, Arxiv, DOI arXiv:1811.10681
[6]   Exploring Representation Learning With CNNs for Frame-to-Frame Ego-Motion Estimation [J].
Costante, Gabriele ;
Mancini, Michele ;
Valigi, Paolo ;
Ciarfuglia, Thomas A. .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2016, 1 (01) :18-25
[7]   Direct Sparse Odometry [J].
Engel, Jakob ;
Koltun, Vladlen ;
Cremers, Daniel .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (03) :611-625
[8]  
Etxeberria-Garcia M, 2020, IEEE/SICE I S SYS IN, P943, DOI [10.1109/sii46433.2020.9026246, 10.1109/SII46433.2020.9026246]
[9]   Visual simultaneous localization and mapping: a survey [J].
Fuentes-Pacheco, Jorge ;
Ruiz-Ascencio, Jose ;
Manuel Rendon-Mancha, Juan .
ARTIFICIAL INTELLIGENCE REVIEW, 2015, 43 (01) :55-81
[10]   PL-SLAM: A Stereo SLAM System Through the Combination of Points and Line Segments [J].
Gomez-Ojeda, Ruben ;
Moreno, Francisco-Angel ;
Zuniga-Noel, David ;
Scaramuzza, Davide ;
Gonzalez-Jimenez, Javier .
IEEE TRANSACTIONS ON ROBOTICS, 2019, 35 (03) :734-746