Compressive Light Field Sensing

被引:81
作者
Babacan, S. Derin [1 ]
Ansorge, Reto [2 ]
Luessi, Martin [3 ]
Ruiz Mataran, Pablo [4 ]
Molina, Rafael [4 ]
Katsaggelos, Aggelos K. [5 ]
机构
[1] Univ Illinois, Beckman Inst Adv Sci & Technol, Urbana, IL 61801 USA
[2] Varian Med Syst, CH-5405 Baden, Switzerland
[3] Harvard Univ, Massachusetts Gen Hosp, Sch Med, Martinos Ctr Biomed Imaging,Dept Radiol, Boston, MA 02114 USA
[4] Univ Granada, Dept Ciencias Comp & Inteligencia Artificial, Granada 18010, Spain
[5] Northwestern Univ, Dept Elect Engn & Comp Sci, Evanston, IL 60208 USA
关键词
Bayesian methods; coded aperture; compressive sensing; computational photography; image reconstruction; light fields; UNCERTAINTY PRINCIPLES;
D O I
10.1109/TIP.2012.2210237
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a novel design for light field image acquisition based on compressive sensing principles. By placing a randomly coded mask at the aperture of a camera, incoherent measurements of the light passing through different parts of the lens are encoded in the captured images. Each captured image is a random linear combination of different angular views of a scene. The encoded images are then used to recover the original light field image via a novel Bayesian reconstruction algorithm. Using the principles of compressive sensing, we show that light field images with a large number of angular views can be recovered from only a few acquisitions. Moreover, the proposed acquisition and recovery method provides light field images with high spatial resolution and signal-to-noise-ratio, and therefore is not affected by limitations common to existing light field camera designs. We present a prototype camera design based on the proposed framework by modifying a regular digital camera. Finally, we demonstrate the effectiveness of the proposed system using experimental results with both synthetic and real images.
引用
收藏
页码:4746 / 4757
页数:12
相关论文
共 47 条
  • [1] SINGLE LENS STEREO WITH A PLENOPTIC CAMERA
    ADELSON, EH
    WANG, JYA
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1992, 14 (02) : 99 - 106
  • [2] [Anonymous], 2008, 2008 IEEE C COMPUTER
  • [3] [Anonymous], 2006, IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
  • [4] Compressive Light Field Imaging
    Ashok, Amit
    Neifeld, Mark A.
    [J]. THREE-DIMENSIONAL IMAGING, VISUALIZATION, AND DISPLAY 2010 AND DISPLAY TECHNOLOGIES AND APPLICATIONS FOR DEFENSE, SECURITY, AND AVIONICS IV, 2010, 7690
  • [5] Parameter estimation in TV image restoration using variational distribution approximation
    Babacan, S. Derin
    Molina, Rafael
    Katsaggelos, Aggelos K.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2008, 17 (03) : 326 - 339
  • [6] COMPRESSIVE SENSING OF LIGHT FIELDS
    Babacan, S. Derin
    Ansorge, Reto
    Luessi, Martin
    Molina, Rafael
    Katsaggelos, Aggelos K.
    [J]. 2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, : 2337 - +
  • [7] IEEE-SPS and connexions - An open access education collaboration
    Baraniuk, Richard G.
    Burrus, C. Sidney
    Thierstein, E. Joel
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2007, 24 (06) : 6 - +
  • [8] Coherence-Based Performance Guarantees for Estimating a Sparse Vector Under Random Noise
    Ben-Haim, Zvika
    Eldar, Yonina C.
    Elad, Michael
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2010, 58 (10) : 5030 - 5043
  • [9] BERGER JO, 1985, STAT DECISION THEORY, pCH3
  • [10] Fast approximate energy minimization via graph cuts
    Boykov, Y
    Veksler, O
    Zabih, R
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (11) : 1222 - 1239