Compressive Light Field Sensing

被引:85
作者
Babacan, S. Derin [1 ]
Ansorge, Reto [2 ]
Luessi, Martin [3 ]
Ruiz Mataran, Pablo [4 ]
Molina, Rafael [4 ]
Katsaggelos, Aggelos K. [5 ]
机构
[1] Univ Illinois, Beckman Inst Adv Sci & Technol, Urbana, IL 61801 USA
[2] Varian Med Syst, CH-5405 Baden, Switzerland
[3] Harvard Univ, Massachusetts Gen Hosp, Sch Med, Martinos Ctr Biomed Imaging,Dept Radiol, Boston, MA 02114 USA
[4] Univ Granada, Dept Ciencias Comp & Inteligencia Artificial, Granada 18010, Spain
[5] Northwestern Univ, Dept Elect Engn & Comp Sci, Evanston, IL 60208 USA
关键词
Bayesian methods; coded aperture; compressive sensing; computational photography; image reconstruction; light fields; UNCERTAINTY PRINCIPLES;
D O I
10.1109/TIP.2012.2210237
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a novel design for light field image acquisition based on compressive sensing principles. By placing a randomly coded mask at the aperture of a camera, incoherent measurements of the light passing through different parts of the lens are encoded in the captured images. Each captured image is a random linear combination of different angular views of a scene. The encoded images are then used to recover the original light field image via a novel Bayesian reconstruction algorithm. Using the principles of compressive sensing, we show that light field images with a large number of angular views can be recovered from only a few acquisitions. Moreover, the proposed acquisition and recovery method provides light field images with high spatial resolution and signal-to-noise-ratio, and therefore is not affected by limitations common to existing light field camera designs. We present a prototype camera design based on the proposed framework by modifying a regular digital camera. Finally, we demonstrate the effectiveness of the proposed system using experimental results with both synthetic and real images.
引用
收藏
页码:4746 / 4757
页数:12
相关论文
共 47 条
[1]   SINGLE LENS STEREO WITH A PLENOPTIC CAMERA [J].
ADELSON, EH ;
WANG, JYA .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1992, 14 (02) :99-106
[2]  
[Anonymous], 2008, 2008 IEEE C COMPUTER
[3]  
[Anonymous], 2006, IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
[4]   Compressive Light Field Imaging [J].
Ashok, Amit ;
Neifeld, Mark A. .
THREE-DIMENSIONAL IMAGING, VISUALIZATION, AND DISPLAY 2010 AND DISPLAY TECHNOLOGIES AND APPLICATIONS FOR DEFENSE, SECURITY, AND AVIONICS IV, 2010, 7690
[5]   Parameter estimation in TV image restoration using variational distribution approximation [J].
Babacan, S. Derin ;
Molina, Rafael ;
Katsaggelos, Aggelos K. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2008, 17 (03) :326-339
[6]   COMPRESSIVE SENSING OF LIGHT FIELDS [J].
Babacan, S. Derin ;
Ansorge, Reto ;
Luessi, Martin ;
Molina, Rafael ;
Katsaggelos, Aggelos K. .
2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, :2337-+
[7]   IEEE-SPS and connexions - An open access education collaboration [J].
Baraniuk, Richard G. ;
Burrus, C. Sidney ;
Thierstein, E. Joel .
IEEE SIGNAL PROCESSING MAGAZINE, 2007, 24 (06) :6-+
[8]   Coherence-Based Performance Guarantees for Estimating a Sparse Vector Under Random Noise [J].
Ben-Haim, Zvika ;
Eldar, Yonina C. ;
Elad, Michael .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2010, 58 (10) :5030-5043
[9]  
BERGER JO, 1985, STAT DECISION THEORY, pCH3
[10]   Fast approximate energy minimization via graph cuts [J].
Boykov, Y ;
Veksler, O ;
Zabih, R .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (11) :1222-1239