FlatCam: Thin, Lensless Cameras Using Coded Aperture and Computation

被引:174
作者
Asif, M. Salman [1 ]
Ayremlou, Ali [2 ]
Sankaranarayanan, Aswin [3 ]
Veeraraghavan, Ashok [4 ]
Baraniuk, Richard G. [4 ]
机构
[1] Univ Calif Riverside, Dept Elect & Comp Engn, Riverside, CA 92521 USA
[2] Lens bricks Inc, Cupertino, CA USA
[3] Carnegie Mellon Univ, Dept ECE, Pittsburgh, PA 15213 USA
[4] Rice Univ, Elect & Comp Engn, Houston, TX USA
来源
IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING | 2017年 / 3卷 / 03期
基金
美国国家科学基金会;
关键词
Computational photography; binary mask; image reconstruction; infrared camera;
D O I
10.1109/TCI.2016.2593662
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
FlatCam is a thin form-factor lensless camera that consists of a coded mask placed on top of a bare, conventional sensor array. Unlike a traditional, lens-based camera, where an image of the scene is directly recorded on the sensor pixels, each pixel in FlatCam records a linear combination of light from multiple scene elements. A computational algorithm is then used to demultiplex the recorded measurements and reconstruct an image of the scene. FlatCam is an instance of a coded aperture imaging system; however, unlike the vast majority of related work, we place the coded mask extremely close to the image sensor that enables thin and flat form-factor imaging devices. We employ a separable mask to ensure that both calibration and image reconstruction are scalable in terms of memory requirements and computational complexity. We demonstrate the potential of the FlatCam design using two prototypes: one at visible wavelengths and one at infrared wavelengths.
引用
收藏
页码:384 / 397
页数:14
相关论文
共 40 条
[31]   PSEUDO-RANDOM SEQUENCES AND ARRAYS [J].
MACWILLIAMS, FJ ;
SLOANE, NJA .
PROCEEDINGS OF THE IEEE, 1976, 64 (12) :1715-1730
[32]   Compressive coded aperture superresolution image reconstruction [J].
Marcia, Roummel E. ;
Willett, Rebecca M. .
2008 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-12, 2008, :833-836
[33]   Compressive Light Field Photography using Overcomplete Dictionaries and Optimized Projections [J].
Marwah, Kshitij ;
Wetzstein, Gordon ;
Bando, Yosuke ;
Raskar, Ramesh .
ACM TRANSACTIONS ON GRAPHICS, 2013, 32 (04)
[34]   NONLINEAR TOTAL VARIATION BASED NOISE REMOVAL ALGORITHMS [J].
RUDIN, LI ;
OSHER, S ;
FATEMI, E .
PHYSICA D, 1992, 60 (1-4) :259-268
[35]   Thin infrared imaging systems through multichannel sampling [J].
Shankar, Mohan ;
Willett, Rebecca ;
Pitsianis, Nikos ;
Schulz, Timothy ;
Gibbons, Robert ;
Kolste, Robert Te ;
Carriere, James ;
Chen, Caihua ;
Prather, Dennis ;
Brady, David .
APPLIED OPTICS, 2008, 47 (10) :B1-B10
[36]   Thin observation module by bound optics (TOMBO): concept and experimental verification [J].
Tanida, J ;
Kumagai, T ;
Yamada, K ;
Miyatake, S ;
Ishida, K ;
Morimoto, T ;
Kondou, N ;
Miyazaki, D ;
Ichioka, Y .
APPLIED OPTICS, 2001, 40 (11) :1806-1813
[37]   Ultrathin cameras using annular folded optics [J].
Tremblay, Eric J. ;
Stack, Ronald A. ;
Morrison, Rick L. ;
Ford, Joseph E. .
APPLIED OPTICS, 2007, 46 (04) :463-471
[38]   Dappled photography: Mask enhanced cameras for heterodyned light fields and coded aperture refocusing [J].
Veeraraghavan, Ashok ;
Raskar, Ramesh ;
Agrawal, Amit ;
Mohan, Ankit ;
Tumblin, Jack .
ACM TRANSACTIONS ON GRAPHICS, 2007, 26 (03)
[39]   Single disperser design for coded aperture snapshot spectral imaging [J].
Wagadarikar, Ashwin ;
John, Renu ;
Willett, Rebecca ;
Brady, David .
APPLIED OPTICS, 2008, 47 (10) :B44-B51
[40]   Angle Sensitive Pixels in CMOS for Lens less 3D Imaging [J].
Wang, Albert ;
Gill, Patrick ;
Molnar, Alyosha .
PROCEEDINGS OF THE IEEE 2009 CUSTOM INTEGRATED CIRCUITS CONFERENCE, 2009, :371-374