Event-Based Line SLAM in Real-Time

被引:35
作者
Chamorro, William [1 ,2 ]
Sola, Joan [1 ]
Andrade-Cetto, Juan [1 ]
机构
[1] CSIC UPC, Inst Robot & Informat Ind, C Llorens Artigas 4-6, Barcelona 08028, Spain
[2] UTE Univ, Dept Engn, Av Mariscal Sucre, Quito 08028, Ecuador
关键词
SLAM; localization; mapping;
D O I
10.1109/LRA.2022.3187266
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Event-based cameras generate asynchronous streams of events, triggered proportionally to the logarithmic change of brightness in the scene. These cameras have very low latency and high dynamic range suitable to address challenging motion scenarios in robotics. In this work, we explore a new event-based line-SLAM approach following a parallel tracking and mapping philosophy. Our fast tracking algorithm, produces accurate camera pose estimates at a high rate by minimizing the event-line reprojection error with an error-state Kalman filter formulated entirely with Lie theory. The mapping thread leverages the natural edge highlighting strength of events to recover and optimize straight lines in human-made scenarios. The proper manipulation of matrix sparsity as well as the information sharing between tracking and mapping nodes allow us to achieve real-time performance on a standard multi-core CPU. This system was tested on several scenarios rich in straight edge objects, and compared against, ground truth and frame and event based state-of-the-art approaches.
引用
收藏
页码:8146 / 8153
页数:8
相关论文
共 28 条
[1]  
Agarwal Sameer, 2022, Ceres Solver
[2]   A 240 x 180 130 dB 3 μs Latency Global Shutter Spatiotemporal Vision Sensor [J].
Brandli, Christian ;
Berner, Raphael ;
Yang, Minhao ;
Liu, Shih-Chii ;
Delbruck, Tobi .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2014, 49 (10) :2333-2341
[3]   ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial, and Multimap SLAM [J].
Campos, Carlos ;
Elvira, Richard ;
Gomez Rodriguez, Juan J. ;
Montiel, Jose M. M. ;
Tardos, Juan D. .
IEEE TRANSACTIONS ON ROBOTICS, 2021, 37 (06) :1874-1890
[4]   EOMVS: Event-Based Omnidirectional Multi-View Stereo [J].
Cho, Hoonhee ;
Jeong, Jaeseok ;
Yoon, Kuk-Jin .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) :6709-6716
[5]  
Deray J., 2019, MANIF SMALL C HEADER
[6]   An Exact Formula for Calculating Inverse Radial Lens Distortions [J].
Drap, Pierre ;
Lefevre, Julien .
SENSORS, 2016, 16 (06)
[7]  
Forster C, 2014, IEEE INT CONF ROBOT, P15, DOI 10.1109/ICRA.2014.6906584
[8]   Event-Based Vision: A Survey [J].
Gallego, Guillermo ;
Delbruck, Tobi ;
Orchard, Garrick Michael ;
Bartolozzi, Chiara ;
Taba, Brian ;
Censi, Andrea ;
Leutenegger, Stefan ;
Davison, Andrew ;
Conradt, Jorg ;
Daniilidis, Kostas ;
Scaramuzza, Davide .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (01) :154-180
[9]   A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimation [J].
Gallego, Guillermo ;
Rebecq, Henri ;
Scaramuzza, Davide .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3867-3876
[10]  
Hernandez W. O. C., 2020, Proc. of the 31st British Machine Vision Virtual Conf, P1