Localization and tracking of stationary users for augmented reality

被引:14
作者
Baker, Lewis [1 ]
Ventura, Jonathan [2 ]
Langlotz, Tobias [1 ]
Gul, Shazia [1 ]
Mills, Steven [1 ]
Zollmann, Stefanie [1 ]
机构
[1] Univ Otago, Dept Comp Sci & Informat Sci, Dunedin, New Zealand
[2] Cal Poly, San Luis Obispo, CA USA
关键词
Localization; Tracking; Augmented reality; Virtual reality; MONOCULAR SLAM; RECOGNITION; ANNOTATIONS;
D O I
10.1007/s00371-023-02777-2
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In augmented reality applications it is essential to know the position and orientation of the user to correctly register virtual 3D content in the user's field of view. For this purpose, visual tracking through simultaneous localization and mapping (SLAM) is often used. However, when applied to the commonly occurring situation where the users are mostly stationary, many methods presented in previous research have two key limitations. First, SLAM techniques alone do not address the problem of global localization with respect to prior models of the environment. Global localization is essential in many applications where multiple users are expected to track within a shared space, such as spectators at a sporting event. Secondly, these methods often assume significant translational movement to accurately reconstruct and track from a local model of the environment, causing challenges for many stationary applications. In this paper, we extend recent research on Spherical Localization and Tracking to support relocalization after tracking failure, as well as global localization in large shared environments, and optimize the method for operation on mobile hardware. We also evaluate various state-of-the-art localization approaches, the robustness of our visual tracking method, and demonstrate the effectiveness of our system in real-life scenarios.
引用
收藏
页码:227 / 244
页数:18
相关论文
共 55 条
[1]   Instant Outdoor Localization and SLAM Initialization from 2.5D Maps [J].
Arth, Clemens ;
Pirchheim, Christian ;
Ventura, Jonathan ;
Schmalstieg, Dieter ;
Lepetit, Vincent .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2015, 21 (11) :1309-1318
[2]   TRACKING REQUIREMENTS FOR AUGMENTED REALITY [J].
AZUMA, R .
COMMUNICATIONS OF THE ACM, 1993, 36 (07) :50-51
[3]  
Baker L, 2020, 2020 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR 2020), P809, DOI [10.1109/VR46266.2020.00006, 10.1109/VR46266.2020.1581313017497]
[4]  
Baker L, 2020, 2020 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES (VR 2020), P782, DOI [10.1109/VR46266.2020.1581313146787, 10.1109/VR46266.2020.000-2]
[5]   The MagicBook - Moving seamlessly between reality and virtuality [J].
Billinghurst, M ;
Kato, H ;
Poupyrev, I .
IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2001, 21 (03) :6-8
[6]  
Bouguet J.-Y, 2001, Intel Corp., V5, P4, DOI DOI 10.1109/ICETET.2009.154
[7]   Expert Sample Consensus Applied to Camera Re-Localization [J].
Brachmann, Eric ;
Rother, Carsten .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :7524-7533
[8]   Learning Less is More-6D Camera Localization via 3D Surface Regression [J].
Brachmann, Eric ;
Rother, Carsten .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :4654-4662
[9]   DSAC - Differentiable RANSAC for Camera Localization [J].
Brachmann, Eric ;
Krull, Alexander ;
Nowozin, Sebastian ;
Shotton, Jamie ;
Michel, Frank ;
Gumhold, Stefan ;
Rother, Carsten .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2492-2500
[10]  
David P, 2003, PROC CVPR IEEE, P424