Procedurally Generated Virtual Reality from 3D Reconstructed Physical Space

被引：96

作者：

Sra, Misha ^{[1
]}

Garrido-Jurado, Sergio ^{[2
]}

Schmandt, Chris ^{[1
]}

Maes, Pattie ^{[1
]}

机构：

[1] MIT, Media Lab, Cambridge, MA 02142 USA

[2] Univ Cordoba, E-14071 Cordoba, Spain

来源：

22ND ACM CONFERENCE ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY (VRST 2016) | 2016年

关键词：

Virtual Reality; Mobile Computing; Procedural Generation; Computer Vision; 3D Reconstruction; Depth Cameras; Locomotion; Obstacle Avoidance; Tracking;

D O I：

10.1145/2993369.2993372

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

We present a novel system for automatically generating immersive and interactive virtual reality (VR) environments using the real world as a template. The system captures indoor scenes in 3D, detects obstacles like furniture and walls, and maps walkable areas (WA) to enable real-walking in the generated virtual environment (VE). Depth data is additionally used for recognizing and tracking objects during the VR experience. The detected objects are paired with virtual counterparts to leverage the physicality of the real world for a tactile experience. Our approach is new, in that it allows a casual user to easily create virtual reality worlds in any indoor space of arbitrary size and shape without requiring specialized equipment or training. We demonstrate our approach through a fully working system implemented on the Google Project Tango tablet device.

引用

页码：191 / 200

页数：10

共 29 条

[1]

Alexandre L. A., 2012, IEEE RSJ INT C INT R, V1, P7

[2]

[Anonymous], SIGGRAPH ASIA 2015 M

[3] A METHOD FOR REGISTRATION OF 3-D SHAPES [J].

BESL, PJ ;

MCKAY, ND .

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1992, 14 (02) :239-256

[4]

Bo L., 2013, Consumer Depth Cameras for Computer Vision: Research Topics and Applications, P167

[5] Travel in immersive virtual environments: An evaluation of viewpoint motion control techniques [J].

Bowman, DA ;

Koller, D ;

Hodges, LF .

IEEE 1997 VIRTUAL REALITY ANNUAL INTERNATIONAL SYMPOSIUM, PROCEEDINGS, 1997, :45-52

[6]

Burdea G., 2003, Virtual reality technology

[7]

Cheng LP, 2015, UIST'15: PROCEEDINGS OF THE 28TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, P417

[8] THE CAVE - AUDIO-VISUAL EXPERIENCE AUTOMATIC VIRTUAL ENVIRONMENT [J].

CRUZNEIRA, C ;

SANDIN, DJ ;

DEFANTI, TA ;

KENYON, RV ;

HART, JC .

COMMUNICATIONS OF THE ACM, 1992, 35 (06) :64-72

[9]

Gibson JJ, 1979, ECOLOGICAL APPROACH

[10] Annexing Reality: Enabling Opportunistic Use of Everyday Objects as Tangible Proxies in Augmented Reality [J].

Hettiarachchi, Anuruddha ;

Wigdor, Daniel .

34TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2016, 2016, :1957-1967

← 1 2 3 →