Holoportation: Virtual 3D Teleportation in Real-time

被引：428

作者：

Orts-Escolano, Sergio ^{[1
]}

Rhemann, Christoph ^{[1
]}

Fanello, Sean ^{[1
]}

Chang, Wayne ^{[1
]}

Kowdle, Adarsh ^{[1
]}

Degtyarev, Yury ^{[1
]}

Kim, David ^{[1
]}

Davidson, Philip ^{[1
]}

Khamis, Sameh ^{[1
]}

Dou, Mingsong ^{[1
]}

Tankovich, Vladimir ^{[1
]}

Loop, Charles ^{[1
]}

Cai, Qin ^{[1
]}

Chou, Philip ^{[1
]}

Mennicken, Sarah ^{[1
]}

Valentin, Julien ^{[1
]}

Pradeep, Vivek ^{[1
]}

Wang, Shenlong ^{[1
]}

Kang, Sing Bing ^{[1
]}

Kohli, Pushmeet ^{[1
]}

Lutchyn, Yuliya ^{[1
]}

Keskin, Cem ^{[1
]}

Izadit, Shahram ^{[1
]}

机构：

[1] Microsoft Res, Redmond, WA 98052 USA

来源：

UIST 2016: PROCEEDINGS OF THE 29TH ANNUAL SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY | 2016年

关键词：

Depth Cameras; 3D capture; Telepresence; Non-rigid reconstruction; Real-time; Mixed Reality; GPU; DISPLAY;

D O I：

10.1145/2984511.2984517

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

We present an end-to-end system for augmented and virtual reality telepresence, called Holoportation. Our system demonstrates high-quality, real-time 3D reconstructions of an entire space, including people, furniture and objects, using a set of new depth cameras. These 3D models can also be transmitted in real-time to remote users. This allows users wearing virtual or augmented reality displays to see, hear and interact with remote participants in 3D, almost as if they were present in the same physical space. From an audio-visual perspective, communicating and interacting with remote users edges closer to face-to-face communication. This paper describes the Holoportation technical system in full, its key interactive capabilities, the application scenarios it enables, and an initial qualitative study of using this new communication medium.

引用

页码：741 / 754

页数：14

共 66 条

[1]

[Anonymous], ACM SIGGRAPH T GRAPH

[2]

[Anonymous], 2013, Proceedings of High Performance Graphics (HPG)

[3]

[Anonymous], 1994, P 1 INT C MED ROB CO

[4]

[Anonymous], 2011, ADV NEURAL INF PROCE

[5]

[Anonymous], 2005, ACM International Conference Proceeding Series

[6]

[Anonymous], 2012, SPRINGER SCI BUSINES

[7]

[Anonymous], ISVC

[8]

Balogh T., 2010, SPIE PHOTONICS EUROP

[9] Recent progress in coded structured light as a technique to solve the correspondence problem: A survey [J].

Batlle, J ;

Mouaddib, E ;

Salvi, J .

PATTERN RECOGNITION, 1998, 31 (07) :963-982

[10] Immersive Group-to-Group Telepresence [J].

Beck, Stephan ;

Kunert, Andre ;

Kulik, Alexander ;

Froehlich, Bernd .

IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2013, 19 (04) :616-625

← 1 2 3 4 5 6 7 →