Event-Based Line SLAM in Real-Time

被引:35
作者
Chamorro, William [1 ,2 ]
Sola, Joan [1 ]
Andrade-Cetto, Juan [1 ]
机构
[1] CSIC UPC, Inst Robot & Informat Ind, C Llorens Artigas 4-6, Barcelona 08028, Spain
[2] UTE Univ, Dept Engn, Av Mariscal Sucre, Quito 08028, Ecuador
关键词
SLAM; localization; mapping;
D O I
10.1109/LRA.2022.3187266
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Event-based cameras generate asynchronous streams of events, triggered proportionally to the logarithmic change of brightness in the scene. These cameras have very low latency and high dynamic range suitable to address challenging motion scenarios in robotics. In this work, we explore a new event-based line-SLAM approach following a parallel tracking and mapping philosophy. Our fast tracking algorithm, produces accurate camera pose estimates at a high rate by minimizing the event-line reprojection error with an error-state Kalman filter formulated entirely with Lie theory. The mapping thread leverages the natural edge highlighting strength of events to recover and optimize straight lines in human-made scenarios. The proper manipulation of matrix sparsity as well as the information sharing between tracking and mapping nodes allow us to achieve real-time performance on a standard multi-core CPU. This system was tested on several scenarios rich in straight edge objects, and compared against, ground truth and frame and event based state-of-the-art approaches.
引用
收藏
页码:8146 / 8153
页数:8
相关论文
共 28 条
[11]   Real-Time 3D Reconstruction and 6-DoF Tracking with an Event Camera [J].
Kim, Hanme ;
Leutenegger, Stefan ;
Davison, Andrew J. .
COMPUTER VISION - ECCV 2016, PT VI, 2016, 9910 :349-364
[12]  
Klein George, 2007, P1
[13]  
Kueng B, 2016, 2016 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2016), P16, DOI 10.1109/IROS.2016.7758089
[14]   IDOL: A Framework for IMU-DVS Odometry using Lines [J].
Le Gentil, Cedric ;
Tschopp, Florian ;
Alzugaray, Ignacio ;
Vidal-Calleja, Teresa ;
Siegwart, Roland ;
Nieto, Juan .
2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, :5863-5870
[15]   EPnP: An Accurate O(n) Solution to the PnP Problem [J].
Lepetit, Vincent ;
Moreno-Noguer, Francesc ;
Fua, Pascal .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2009, 81 (02) :155-166
[16]   A 128x128 120 dB 15 μs latency asynchronous temporal contrast vision sensor [J].
Lichtsteiner, Patrick ;
Posch, Christoph ;
Delbruck, Tobi .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2008, 43 (02) :566-576
[17]   The event-camera dataset and simulator: Event-based data for pose estimation, visual odometry, and SLAM [J].
Mueggler, Elias ;
Rebecq, Henri ;
Gallego, Guillermo ;
Delbruck, Tobi ;
Scaramuzza, Davide .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2017, 36 (02) :142-149
[18]  
Rebecq H, 2017, P BRIT MACH VIS C
[19]   EMVS: Event-Based Multi-View Stereo3D Reconstruction with an Event Camera in Real-Time [J].
Rebecq, Henri ;
Gallego, Guillermo ;
Mueggler, Elias ;
Scaramuzza, Davide .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2018, 126 (12) :1394-1414
[20]   EVO: A Geometric Approach to Event-Based 6-DOF Parallel Tracking and Mapping in Real Time [J].
Rebecq, Henri ;
Horstschaefer, Timo ;
Gallego, Guillermo ;
Scaramuzza, Davide .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2017, 2 (02) :593-600