Linear Volumetric Focus for Light Field Cameras

被引:133
作者
Dansereau, Donald G. [1 ]
Pizarro, Oscar [1 ]
Williams, Stefan B. [1 ]
机构
[1] Univ Sydney, Sch Aerosp Mech & Mechtron Engn, Australian Ctr Field Robot, Sydney, NSW 2006, Australia
来源
ACM TRANSACTIONS ON GRAPHICS | 2015年 / 34卷 / 02期
关键词
Algorithms; Theory; Design; Light field filtering; digital refocusing; plenoptic cameras; computational photography; Fourier analysis; DEPTH; SPARSE; SVD;
D O I
10.1145/2665074
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We demonstrate that the redundant information in light field imagery allows volumetric focus, an improvement of signal quality that maintains focus over a controllable range of depths. To do this, we derive the frequency-domain region of support of the light field, finding it to be the 4D hyperfan at the intersection of a dual fan and a hypercone, and design a filter with correspondingly shaped passband. Drawing examples from the Stanford Light Field Archive and images captured using a commercially available lenslet-based plenoptic camera, we demonstrate that the hyperfan outperforms competing methods including planar focus, fan-shaped antialiasing, and nonlinear image and video denoising techniques. We show the hyperfan preserves depth of field, making it a single-step all-in-focus denoising filter suitable for general-purpose light field rendering. We include results for different noise types and levels, through murky water and particulate matter, in real-world scenarios, and evaluated using a variety of metrics. We show that the hyperfan's performance scales with aperture count, and demonstrate the inclusion of aliased components for high-quality rendering.
引用
收藏
页数:20
相关论文
共 61 条
  • [21] Dansereau D. G., 2003, THESIS U CALGARY
  • [22] Dansereau D. G., 2014, THESIS U SYDNEY
  • [23] A 4-D dual-fan filter bank for depth filtering in light fields
    Dansereau, Don
    Bruton, Len T.
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2007, 55 (02) : 542 - 549
  • [24] Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras
    Dansereau, Donald G.
    Pizarro, Oscar
    Williams, Stefan B.
    [J]. 2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, : 1027 - 1034
  • [25] Dansereau DG, 2011, IEEE INT C INT ROBOT, P4455, DOI 10.1109/IROS.2011.6048841
  • [26] Dansereau DG, 2011, IEEE INT CONF ROBOT, P1634
  • [27] A frequency analysis of light transport
    Durand, F
    Holzschuch, N
    Soler, C
    Chan, E
    Sillion, FX
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2005, 24 (03): : 1115 - 1126
  • [28] Image denoising via sparse and redundant representations over learned dictionaries
    Elad, Michael
    Aharon, Michal
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (12) : 3736 - 3745
  • [29] Freeman W., 2009, MITCSAILTR2009019
  • [30] Visual perception and the statistical properties of natural scenes
    Geisler, Wilson S.
    [J]. ANNUAL REVIEW OF PSYCHOLOGY, 2008, 59 : 167 - 192