Synthesis of high dynamic range motion blur free image from multiple captures

被引:47
作者
Liu, XQ [1 ]
El Gamal, A [1 ]
机构
[1] Stanford Univ, Informat Syst Lab, Dept Elect Engn, Palo Alto, CA 94304 USA
关键词
CMOS image sensor; dynamic range extension; motion blur restoration; motion detection; photocurrent estimation; saturation detection;
D O I
10.1109/TCSI.2003.809815
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Advances in CMOS image sensors enable high-speed image readout, which makes it possible to capture multiple images within a normal exposure time. Earlier work has demonstrated the use of this capability to enhance sensor dynamic range. This paper presents an algorithm for synthesizing a high dynamic range, motion blur free, still image from multiple captures. The algorithm consists of two main procedures, photocurrent estimation and saturation and motion detection. Estimation is used to reduce read noise, and, thus, to enhance dynamic range at the low illumination end. Saturation detection is used to enhance, dynamic range at the high illumination end as previously proposed, while motion blur detection ensures that the estimation is not corrupted by motion. Motion blur detection also makes it possible to extend exposure time and to capture more images, which can be used to further enhance dynamic range at the low illumination end. Our algorithm operates completely locally; each pixel's, final value is computed using only its captured values, and recursively, requiring the, storage of only a constant number of values per pixel independent of the number of images captured. Simulation and experimental results demonstrate the enhanced signal-to-noise ratio (SNR), dynamic range, and the motion blur prevention achieved using the algorithm.
引用
收藏
页码:530 / 539
页数:10
相关论文
共 27 条
[1]  
Aggarwal M, 2001, EIGHTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOL I, PROCEEDINGS, P2, DOI 10.1109/ICCV.2001.937492
[2]  
[Anonymous], P IEEE INT C AC SPEE
[3]  
Culurciello E., 2001, 2001 IEEE International Solid-State Circuits Conference. Digest of Technical Papers. ISSCC (Cat. No.01CH37177), P92, DOI 10.1109/ISSCC.2001.912560
[4]   A 256x256 CMOS imaging array with wide dynamic range pixels and column-parallel digital output [J].
Decker, S ;
McGrath, RD ;
Brehmer, K ;
Sodini, CG .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 1998, 33 (12) :2081-2091
[5]  
DELBRUCK T, 1994, 30 CNS
[6]  
Ercan A. O., 2002, Proceedings of IEEE Sensors 2002. First IEEE International Conference on Sensors (Cat. No.02CH37394), P15, DOI 10.1109/ICSENS.2002.1036979
[7]   CMOS image sensors: Electronic camera-on-a-chip [J].
Fossum, ER .
IEEE TRANSACTIONS ON ELECTRON DEVICES, 1997, 44 (10) :1689-1698
[8]  
FOSSUM ER, 1993, P SOC PHOTO-OPT INS, V1900, P2, DOI 10.1117/12.148585
[9]   A logarithmic response CMOS image sensor with on-chip calibration [J].
Kavadias, S ;
Dierickx, B ;
Scheffer, D ;
Alaerts, A ;
Uwaerts, D ;
Bogaerts, J .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2000, 35 (08) :1146-1152
[10]   A 10 000 frames/s CMOS digital pixel sensor [J].
Kleinfelder, S ;
Lim, S ;
Liu, XQ ;
El Gamal, A .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2001, 36 (12) :2049-2059