Linear Volumetric Focus for Light Field Cameras

被引:133
作者
Dansereau, Donald G. [1 ]
Pizarro, Oscar [1 ]
Williams, Stefan B. [1 ]
机构
[1] Univ Sydney, Sch Aerosp Mech & Mechtron Engn, Australian Ctr Field Robot, Sydney, NSW 2006, Australia
来源
ACM TRANSACTIONS ON GRAPHICS | 2015年 / 34卷 / 02期
关键词
Algorithms; Theory; Design; Light field filtering; digital refocusing; plenoptic cameras; computational photography; Fourier analysis; DEPTH; SPARSE; SVD;
D O I
10.1145/2665074
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We demonstrate that the redundant information in light field imagery allows volumetric focus, an improvement of signal quality that maintains focus over a controllable range of depths. To do this, we derive the frequency-domain region of support of the light field, finding it to be the 4D hyperfan at the intersection of a dual fan and a hypercone, and design a filter with correspondingly shaped passband. Drawing examples from the Stanford Light Field Archive and images captured using a commercially available lenslet-based plenoptic camera, we demonstrate that the hyperfan outperforms competing methods including planar focus, fan-shaped antialiasing, and nonlinear image and video denoising techniques. We show the hyperfan preserves depth of field, making it a single-step all-in-focus denoising filter suitable for general-purpose light field rendering. We include results for different noise types and levels, through murky water and particulate matter, in real-world scenarios, and evaluated using a variety of metrics. We show that the hyperfan's performance scales with aperture count, and demonstrate the inclusion of aliased components for high-quality rendering.
引用
收藏
页数:20
相关论文
共 61 条
  • [1] SINGLE LENS STEREO WITH A PLENOPTIC CAMERA
    ADELSON, EH
    WANG, JYA
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1992, 14 (02) : 99 - 106
  • [2] Invertible Motion Blur in Video
    Agrawal, Amit
    Xu, Yi
    Raskar, Ramesh
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2009, 28 (03):
  • [3] K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation
    Aharon, Michal
    Elad, Michael
    Bruckstein, Alfred
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) : 4311 - 4322
  • [4] [Anonymous], INT ROB SYST 2004 IR
  • [5] [Anonymous], 2009, INT C COMP PHOT
  • [6] [Anonymous], P SPIE C COMP IM SPI
  • [7] EFFICIENT IIR AND FIR FAN FILTERS
    ANSARI, R
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS, 1987, 34 (08): : 941 - 945
  • [8] Plenoptic manifolds
    Berent, Jesse
    Dragotti, Pier Luigi
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2007, 24 (06) : 34 - 44
  • [9] The Light Field Camera: Extended Depth of Field, Aliasing, and Superresolution
    Bishop, Tom E.
    Favaro, Paolo
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (05) : 972 - 986
  • [10] Depth estimation using the compound eye of dipteran flies
    Bitsakos, Konstantinos
    Fermueller, Cornelia
    [J]. BIOLOGICAL CYBERNETICS, 2006, 95 (05) : 487 - 501