A QVGA 143 dB Dynamic Range Frame-Free PWM Image Sensor With Lossless Pixel-Level Video Compression and Time-Domain CDS

被引:579
作者
Posch, Christoph [1 ]
Matolin, Daniel [1 ]
Wohlgenannt, Rainer [1 ]
机构
[1] AIT Austrian Inst Technol GmbH, Dept Safety & Secur, A-1220 Vienna, Austria
关键词
Address-event representation (AER); biomimetics; CMOS image sensor; event-based vision; focal-plane processing; high dynamic range (HDR); neuromorphic electronics; time-domain CDS; time-domain imaging; video compression; ARRAY;
D O I
10.1109/JSSC.2010.2085952
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The biomimetic CMOS dynamic vision and image sensor described in this paper is based on a QVGA (304x240) array of fully autonomous pixels containing event-based change detection and pulse-width-modulation (PWM) imaging circuitry. Exposure measurements are initiated and carried out locally by the individual pixel that has detected a change of brightness in its field-of-view. Pixels do not rely on external timing signals and independently and asynchronously request access to an (asynchronous arbitrated) output channel when they have new grayscale values to communicate. Pixels that are not stimulated visually do not produce output. The visual information acquired from the scene, temporal contrast and grayscale data, are communicated in the form of asynchronous address-events (AER), with the grayscale values being encoded in inter-event intervals. The pixel-autonomous and massively parallel operation ideally results in lossless video compression through complete temporal redundancy suppression at the pixel level. Compression factors depend on scene activity and peak at similar to 1000 for static scenes. Due to the time-based encoding of the illumination information, very high dynamic range-intra-scene DR of 143 dB static and 125 dB at 30 fps equivalent temporal resolution-is achieved. A novel time-domain correlated double sampling (TCDS) method yields array FPN of <0.25% rms. SNR is >56 dB (9.3 bit) for >10 Lx illuminance.
引用
收藏
页码:259 / 275
页数:17
相关论文
共 47 条
[1]   Computational image sensor for on sensor compression [J].
Aizawa, K ;
Egi, Y ;
Hamamoto, T ;
Hatori, M ;
Abe, M ;
Maruyama, H ;
Otake, H .
IEEE TRANSACTIONS ON ELECTRON DEVICES, 1997, 44 (10) :1724-1730
[2]  
[Anonymous], ISSCC 2007 11 15 FEB
[3]  
[Anonymous], IEEE T CIRC SYST VID
[4]  
[Anonymous], IEEE ISSCC
[5]  
[Anonymous], IEEE INT S CIRC SYST
[6]   Embedded Vehicle Speed Estimation System Using an Asynchronous Temporal Contrast Vision Sensor [J].
Bauer, D. ;
Belbachir, A. N. ;
Donath, N. ;
Gritsch, G. ;
Kohn, B. ;
Litzenberger, M. ;
Posch, C. ;
Schoen, P. ;
Schraml, S. .
EURASIP JOURNAL ON EMBEDDED SYSTEMS, 2007, (01)
[7]   Neuromorphic microchips [J].
Boahen, K .
SCIENTIFIC AMERICAN, 2005, 292 (05) :56-63
[8]   A burst-mode word-serial address-event link-I transmitter design [J].
Boahen, KA .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2004, 51 (07) :1269-1280
[9]   Point-to-point connectivity between neuromorphic chips using address events [J].
Boahen, KA .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2000, 47 (05) :416-434
[10]   A VLSI sorting image sensor: Global massively parallel intensity-to-time processing for low-latency adaptive vision [J].
Brajovic, V ;
Kanade, T .
IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, 1999, 15 (01) :67-75