3D live: Real time captured content for mixed reality

被引：29

作者：

Prince, S ^{[1
]}

Cheok, AD ^{[1
]}

Farbiz, F ^{[1
]}

Williamson, T ^{[1
]}

Johnson, N ^{[1
]}

Billinghurst, M ^{[1
]}

Kato, H ^{[1
]}

机构：

[1] Natl Univ Singapore, Singapore 117548, Singapore

来源：

INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY, PROCEEDINGS | 2002年

关键词：

mixed reality; augmented reality; shape-from-silhouette; 3-D reconstruction; video-conferencing;

D O I：

10.1109/ISMAR.2002.1115062

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

We present a complete system for live capture of 3-D content and simultaneous presentation in augmented reality. The user sees the real world. m his viewpoint, but fro modified so that the image of a remote collaborator is rendered into the scene. Fifteen cameras surround the collaborator, and the resulting video streams are used to construct a three-dimensional model of the subject using a shape-from-silhouette algorithm. Users view a two-dimensional fiducial marker using a video-see-through augmented reality interface. The geometric relationship between the marker and head-mounted camera is calculated, and the equivalent view of the subject is computed and drawn into the scene. Our system can generate 384 x 288 pixel images of the models at 25fps, with a latency of <100ms. The result gives the strong impression that the subject is a real part of the 3-D scene. We demonstrate applications of this system in 3-D video-conferencing and entertainment.

引用

页码：7 / +

页数：8

共 19 条

[1] Novel view synthesis by cascading trilinear tensors
Avidan, S
Shashua, A
[J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 1998, 4 (04) : 293 - 306
[2] Recent advances in augmented reality
Azuma, R
Baillot, Y
Behringer, R
Feiner, S
Julier, S
MacIntyre, B
[J]. IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2001, 21 (06) : 34 - 47
[3] A survey of augmented reality
Azuma, RT
[J]. PRESENCE-VIRTUAL AND AUGMENTED REALITY, 1997, 6 (04): : 355 - 385
[4] BILLINGHURST M, 1999, P CHI
[5] Billinghurst M, 2000, IEEE INT C MULT EXP
[6] The power of a nod and a glance:: Envelope vs. emotional feedback in animated conversational agents
Cassell, J
Thórisson, KR
[J]. APPLIED ARTIFICIAL INTELLIGENCE, 1999, 13 (4-5) : 519 - 538
[7] RANDOM SAMPLE CONSENSUS - A PARADIGM FOR MODEL-FITTING WITH APPLICATIONS TO IMAGE-ANALYSIS AND AUTOMATED CARTOGRAPHY
FISCHLER, MA
BOLLES, RC
[J]. COMMUNICATIONS OF THE ACM, 1981, 24 (06) : 381 - 395
[8] KANADE T, 1995, IROS '95 - 1995 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS: HUMAN ROBOT INTERACTION AND COOPERATIVE ROBOTS, PROCEEDINGS, VOL 3, P95, DOI 10.1109/IROS.1995.525868
[9] Virtual object manipulation on a table-top AR environment
Kato, H
Billinghurst, M
Poupyrev, I
Imamoto, K
Tachibana, K
[J]. IEEE AND ACM INTERNATIONAL SYMPOSIUM ON AUGMENTED REALITY, PROCEEDING, 2000, : 111 - 119
[10] Kato H., 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99), P85, DOI 10.1109/IWAR.1999.803809

← 1 2 →