Jump: Virtual Reality Video

被引：171

作者：

Anderson, Robert ^{[1
]}

Gallup, David ^{[1
]}

Barron, Jonathan T. ^{[1
]}

Kontkanen, Janne ^{[1
]}

Snavely, Noah ^{[1
]}

Hernandez, Carlos ^{[1
]}

Agarwal, Sameer ^{[1
]}

Seitz, Steven M. ^{[1
]}

机构：

[1] Google Inc, Mountain View, CA 94043 USA

来源：

ACM TRANSACTIONS ON GRAPHICS | 2016年 / 35卷 / 06期

关键词：

Panoramic stereo imaging; Video stitching;

D O I：

10.1145/2980179.2980257

中图分类号：

TP31 [计算机软件];

学科分类号：

081202 ; 0835 ;

摘要：

We present Jump, a practical system for capturing high resolution, omnidirectional stereo (ODS) video suitable for wide scale consumption in currently available virtual reality (VR) headsets. Our system consists of a video camera built using off-the-shelf components and a fully automatic stitching pipeline capable of capturing video content in the ODS format. We have discovered and analyzed the distortions inherent to ODS when used for VR display as well as those introduced by our capture method and show that they are small enough to make this approach suitable for capturing a wide variety of scenes. Our stitching algorithm produces robust results by reducing the problem to one of pairwise image interpolation followed by compositing. We introduce novel optical flow and compositing methods designed specifically for this task. Our algorithm is temporally coherent and efficient, is currently running at scale on a distributed computing platform, and is capable of processing hours of footage each day.

引用

页数：13