Kernel Foveated Rendering

被引:60
作者
Meng, Xiaoxu [1 ,2 ]
Du, Ruofei [1 ,2 ]
Zwicker, Matthias [1 ,2 ]
Varshney, Amitabh [1 ,2 ]
机构
[1] Univ Maryland, Dept Comp Sci, College Pk, MD 20742 USA
[2] Univ Maryland, Inst Adv Comp Studies UMIACS, College Pk, MD 20742 USA
关键词
foveated rendering; perception; log-polar mapping; eye-tracking; virtual reality; head-mounted displays;
D O I
10.1145/3203199
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Foveated rendering coupled with eye-tracking has the potential to dramatically accelerate interactive 3D graphics with minimal loss of perceptual detail. In this paper, we parameterize foveated rendering by embedding polynomial kernel functions in the classic log-polar mapping. Our GPU-driven technique uses closedform, parameterized foveation that mimics the distribution of photoreceptors in the human retina. We present a simple two-pass kernel foveated rendering (KFR) pipeline that maps well onto modern GPUs. In the first pass, we compute the kernel log-polar transformation and render to a reduced-resolution buffer. In the second pass, we carry out the inverse-log-polar transformation with anti-aliasing to map the reduced-resolution rendering to the full-resolution screen. We have carried out pilot and formal user studies to empirically identify the KFR parameters. We observe a 2.8X - 3.2X speedup in rendering on 4K UHD (2160p) displays with minimal perceptual loss of detail. The relevance of eye-tracking-guided kernel foveated rendering can only increase as the anticipated rise of display resolution makes it ever more difficult to resolve the mutually conflicting goals of interactive rendering and perceptual realism.
引用
收藏
页数:20
相关论文
共 51 条
[1]  
Amazon Lumberyard, 2017, AM LUMB BISTR
[2]   Speeding up the log-polar transform with inexpensive parallel hardware: graphics units and multi-core architectures [J].
Antonelli, Marco ;
Igual, Francisco D. ;
Ramos, Francisco ;
Traver, V. Javier .
JOURNAL OF REAL-TIME IMAGE PROCESSING, 2015, 10 (03) :533-550
[3]  
Araujo H, 1997, II WORKSHOP ON CYBERNETIC VISION, PROCEEDINGS, P139
[4]   SMART SENSING WITHIN A PYRAMID VISION MACHINE [J].
BURT, PJ .
PROCEEDINGS OF THE IEEE, 1988, 76 (08) :1006-1015
[5]  
Chajdas M.G., 2011, P S INT 3D GRAPH GAM, P15, DOI DOI 10.1145/1944745.1944748
[6]   Wavelet foveation [J].
Chang, EC ;
Mallat, S ;
Yap, C .
APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2000, 9 (03) :312-335
[7]  
ChrisWyman, 2017, FALCOR RENDERING FRA
[8]   AMFS: Adaptive Multi-Frequency Shading for Future Graphics Processors [J].
Clarberg, Petrik ;
Toth, Robert ;
Hasselgren, Jon ;
Nilsson, Jim ;
Akenine-Moeller, Tomas .
ACM TRANSACTIONS ON GRAPHICS, 2014, 33 (04)
[9]   Aggregate G-Buffer Anti-Aliasing [J].
Crassin, Cyril ;
McGuire, Morgan ;
Fatahalian, Kayvon ;
Lefohn, Aaron .
PROCEEDINGS - I3D 2015, 2015, :109-119
[10]  
Duluk Jr Jerome F, 2004, US Patent, Patent No. [6,717,576, 6717576]