FlatCam: Thin, Lensless Cameras Using Coded Aperture and Computation

被引:174
作者
Asif, M. Salman [1 ]
Ayremlou, Ali [2 ]
Sankaranarayanan, Aswin [3 ]
Veeraraghavan, Ashok [4 ]
Baraniuk, Richard G. [4 ]
机构
[1] Univ Calif Riverside, Dept Elect & Comp Engn, Riverside, CA 92521 USA
[2] Lens bricks Inc, Cupertino, CA USA
[3] Carnegie Mellon Univ, Dept ECE, Pittsburgh, PA 15213 USA
[4] Rice Univ, Elect & Comp Engn, Houston, TX USA
来源
IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING | 2017年 / 3卷 / 03期
基金
美国国家科学基金会;
关键词
Computational photography; binary mask; image reconstruction; infrared camera;
D O I
10.1109/TCI.2016.2593662
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
FlatCam is a thin form-factor lensless camera that consists of a coded mask placed on top of a bare, conventional sensor array. Unlike a traditional, lens-based camera, where an image of the scene is directly recorded on the sensor pixels, each pixel in FlatCam records a linear combination of light from multiple scene elements. A computational algorithm is then used to demultiplex the recorded measurements and reconstruct an image of the scene. FlatCam is an instance of a coded aperture imaging system; however, unlike the vast majority of related work, we place the coded mask extremely close to the image sensor that enables thin and flat form-factor imaging devices. We employ a separable mask to ensure that both calibration and image reconstruction are scalable in terms of memory requirements and computational complexity. We demonstrate the potential of the FlatCam design using two prototypes: one at visible wavelengths and one at infrared wavelengths.
引用
收藏
页码:384 / 397
页数:14
相关论文
共 40 条
[11]   Image denoising by sparse 3-D transform-domain collaborative filtering [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (08) :2080-2095
[12]   Lensless coded-aperture imaging with separable Doubly-Toeplitz masks [J].
DeWeert, Michael J. ;
Farm, Brian P. .
OPTICAL ENGINEERING, 2015, 54 (02)
[13]   SCATTER-HOLE CAMERAS FOR X-RAYS AND GAMMA RAYS [J].
DICKE, RH .
ASTROPHYSICAL JOURNAL, 1968, 153 (2P2) :L101-&
[14]   Complementary lattice arrays for coded aperture imaging [J].
Ding, Jie ;
Noshad, Mohammad ;
Tarokh, Vahid .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2016, 33 (05) :863-881
[15]   Compressed sensing [J].
Donoho, DL .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (04) :1289-1306
[16]   CMOS Wafer Bonding for Back-Side Illuminated Image Sensors Fabrication [J].
Dragoi, V. ;
Filbert, A. ;
Zhu, S. ;
Mittendorfer, G. .
2010 11TH INTERNATIONAL CONFERENCE ON ELECTRONIC PACKAGING TECHNOLOGY & HIGH DENSITY PACKAGING (ICEPT-HDP), 2010, :27-30
[17]   The application of pinhole and coded aperture imaging in the nuclear environment [J].
Durrant, PT ;
Dallimore, M ;
Jupp, ID ;
Ramsden, D .
NUCLEAR INSTRUMENTS & METHODS IN PHYSICS RESEARCH SECTION A-ACCELERATORS SPECTROMETERS DETECTORS AND ASSOCIATED EQUIPMENT, 1999, 422 (1-3) :667-671
[18]   FAST DELTA-HADAMARD TRANSFORM [J].
FENIMORE, EE ;
WESTON, GS .
APPLIED OPTICS, 1981, 20 (17) :3058-3067
[19]   CODED APERTURE IMAGING WITH UNIFORMLY REDUNDANT ARRAYS [J].
FENIMORE, EE ;
CANNON, TM .
APPLIED OPTICS, 1978, 17 (03) :337-347
[20]  
Gill P. R., 2013, COMP OPT SENS IM ARL