Sensor fusion and occlusion refinement for tablet-based AR

被引:25
作者
Klein, G [1 ]
Drummond, T [1 ]
机构
[1] Univ Cambridge, Dept Engn, Cambridge CB1 2PZ, England
来源
ISMAR 2004: THIRD IEEE AND ACM INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY | 2004年
关键词
D O I
10.1109/ISMAR.2004.54
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a set of technologies which enable robust, accurate, high resolution augmentation of live video, delivered via a tablet PC to which a video camera has been attached. By combining several technologies this is achieved without the use of contrived markers in the environment: An outside-in tracker observes the tablet to generate robust, low-accuracy pose estimates. An inside-out tracker running on the tablet observes the video feed from the tablet-mounted camera and provides high-accuracy pose estimates by tracking natural features in the environment. Information from both of these trackers is combined in an Extended Kalman Filter. Finally, to maximise the quality of the augmented imagery, boundaries where the real world occludes the virtual imagery are identified and another tracker is used to refine the boundaries between real and virtual imagery so that their synthesis is as convincing as possible.
引用
收藏
页码:38 / 47
页数:10
相关论文
共 23 条
[1]  
[Anonymous], 1995, INTRO KALMAN FILTER
[2]  
BAILLOT T, 2003, P INT S MIX AUGM REA, P142
[3]   DYNAMIC REGISTRATION CORRECTION IN VIDEO-BASED AUGMENTED REALITY SYSTEMS [J].
BAJURA, M ;
NEUMANN, U .
IEEE COMPUTER GRAPHICS AND APPLICATIONS, 1995, 15 (05) :52-60
[4]   Resolving occlusion in augmented reality: a contour based approach without 3D reconstruction [J].
Berger, MO .
1997 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, 1997, :91-96
[5]  
BREEN D, 1996, P EUR 96 POIT FRANC, P11
[6]  
CIPRA T, 1991, KYBERNETIKA, V27, P481
[7]  
FUHRMANN A, 1999, P 5 EUROGRAPHICS WOR
[8]  
Kanbara M., 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048), P255, DOI 10.1109/VR.2000.840506
[9]  
Kato H., 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99), P85, DOI 10.1109/IWAR.1999.803809
[10]   Robust visual tracking for non-instrumented augmented reality [J].
Klein, G ;
Drummond, T .
SECOND IEEE AND ACM INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY, PROCEEDINGS, 2003, :113-122