Linear Volumetric Focus for Light Field Cameras

被引:133
作者
Dansereau, Donald G. [1 ]
Pizarro, Oscar [1 ]
Williams, Stefan B. [1 ]
机构
[1] Univ Sydney, Sch Aerosp Mech & Mechtron Engn, Australian Ctr Field Robot, Sydney, NSW 2006, Australia
来源
ACM TRANSACTIONS ON GRAPHICS | 2015年 / 34卷 / 02期
关键词
Algorithms; Theory; Design; Light field filtering; digital refocusing; plenoptic cameras; computational photography; Fourier analysis; DEPTH; SPARSE; SVD;
D O I
10.1145/2665074
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We demonstrate that the redundant information in light field imagery allows volumetric focus, an improvement of signal quality that maintains focus over a controllable range of depths. To do this, we derive the frequency-domain region of support of the light field, finding it to be the 4D hyperfan at the intersection of a dual fan and a hypercone, and design a filter with correspondingly shaped passband. Drawing examples from the Stanford Light Field Archive and images captured using a commercially available lenslet-based plenoptic camera, we demonstrate that the hyperfan outperforms competing methods including planar focus, fan-shaped antialiasing, and nonlinear image and video denoising techniques. We show the hyperfan preserves depth of field, making it a single-step all-in-focus denoising filter suitable for general-purpose light field rendering. We include results for different noise types and levels, through murky water and particulate matter, in real-world scenarios, and evaluated using a variety of metrics. We show that the hyperfan's performance scales with aperture count, and demonstrate the inclusion of aliased components for high-quality rendering.
引用
收藏
页数:20
相关论文
共 61 条
  • [11] EPIPOLAR-PLANE IMAGE-ANALYSIS - AN APPROACH TO DETERMINING STRUCTURE FROM MOTION
    BOLLES, RC
    BAKER, HH
    MARIMONT, DH
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 1987, 1 (01) : 7 - 55
  • [12] A review of image denoising algorithms, with a new one
    Buades, A
    Coll, B
    Morel, JM
    [J]. MULTISCALE MODELING & SIMULATION, 2005, 4 (02) : 490 - 530
  • [13] Equiripple FIR filter design by the FFT algorithm
    Cetin, AE
    Gerek, ON
    Yardimci, Y
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 1997, 14 (02) : 60 - 64
  • [14] Chai JX, 2000, COMP GRAPH, P307, DOI 10.1145/344779.344932
  • [15] A spectral analysis for light field rendering
    Chan, SC
    Shum, HY
    [J]. 2000 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL II, PROCEEDINGS, 2000, : 25 - 28
  • [16] When Does Computational Imaging Improve Performance?
    Cossairt, Oliver
    Gupta, Mohit
    Nayar, Shree K.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (02) : 447 - 458
  • [17] Dabov K., 2007, Proc. 15th European Signal Processing Conference, V1, P7
  • [18] Reflectance and texture of real-world surfaces
    Dana, KJ
    Van Ginneken, B
    Nayar, SK
    Koenderink, JJ
    [J]. ACM TRANSACTIONS ON GRAPHICS, 1999, 18 (01): : 1 - 34
  • [19] Dansereau D, 2004, 2004 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL 3, PROCEEDINGS, P549
  • [20] Dansereau D, 2003, PROCEEDINGS OF THE 2003 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL IV, P476