Poker-DVS and MNIST-DVS. Their History, How They Were Made, and Other Details

被引:74
作者
Serrano-Gotarredona, Teresa
Linares-Barranco, Bernabe [1 ]
机构
[1] CSIC, Inst Microelect Sevilla IMSE CNM, E-41080 Seville, Spain
关键词
event-driven vision; event-driven object recognition; dynamic vision sensor (DVS); address event representation; high speed vision; frame-free vision; LATENCY; RETINA; DRIVEN; SENSOR;
D O I
10.3389/fnins.2015.00481
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
This article reports on two databases for event driven object recognition using a Dynamic Vision Sensor (DVS). The first, which we call Poker-DVS and is being released together with this article, was obtained by browsing specially made poker card decks in front of a DVS camera for 2-4 s. Each card appeared on the screen for about 20-30 ms. The poker pips were tracked and isolated off-line to constitute the 131 recording Poker DVS database. The second database, which we call MNIST-DVS and which was released in December 2013, consists of a set of 30,000 DVS camera recordings obtained by displaying 10,000 moving symbols from the standard MNIST 70,000-picture database on an LCD monitor for about 2-3 s each. Each of the 10,000 symbols was displayed at three different scales, so that event-driven object recognition algorithms could easily be tested for different object sizes. This article tells the story behind both databases, covering, among other aspects, details of how they work and the reasons for their creation. We provide not only the databases with corresponding scripts, but also the scripts and data used to generate the figures shown in this article (as Supplementary Material).
引用
收藏
页数:10
相关论文
共 24 条
[1]   A 3.6 μs Latency Asynchronous Frame-Free Event-Driven Dynamic-Vision-Sensor [J].
Antonio Lenero-Bardallo, Juan ;
Serrano-Gotarredona, Teresa ;
Linares-Barranco, Bernabe .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2011, 46 (06) :1443-1455
[2]   A Five-Decade Dynamic-Range Ambient-Light-Independent Calibrated Signed-Spatial-Contrast AER Retina With 0.1-ms Latency and Optional Time-to-First-Spike Mode [J].
Antonio Lenero-Bardallo, Juan ;
Serrano-Gotarredona, Teresa ;
Linares-Barranco, Bernabe .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2010, 57 (10) :2632-2643
[3]   Mapping from Frame-Driven to Frame-Free Event-Driven Vision Systems by Low-Rate Rate Coding and Coincidence Processing-Application to Feedforward ConvNets [J].
Antonio Perez-Carrasco, Jose ;
Zhao, Bo ;
Serrano, Carmen ;
Acha, Begona ;
Serrano-Gotarredona, Teresa ;
Chen, Shouchun ;
Linares-Barranco, Bernabe .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (11) :2706-2719
[4]   Fast Vision Through Frameless Event-Based Sensing and Convolutional Processing: Application to Texture Recognition [J].
Antonio Perez-Carrasco, Jose ;
Acha, Begona ;
Serrano, Carmen ;
Camunas-Mesa, Luis ;
Serrano-Gotarredona, Teresa ;
Linares-Barranco, Bernabe .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2010, 21 (04) :609-620
[5]   Point-to-point connectivity between neuromorphic chips using address events [J].
Boahen, KA .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2000, 47 (05) :416-434
[6]   A 240 x 180 130 dB 3 μs Latency Global Shutter Spatiotemporal Vision Sensor [J].
Brandli, Christian ;
Berner, Raphael ;
Yang, Minhao ;
Liu, Shih-Chii ;
Delbruck, Tobi .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2014, 49 (10) :2333-2341
[7]   An Event-Driven Multi-Kernel Convolution Processor Module for Event-Driven Vision Sensors [J].
Camunas-Mesa, Luis ;
Zamarreno-Ramos, Carlos ;
Linares-Barranco, Alejandro ;
Acosta-Jimenez, Antonio J. ;
Serrano-Gotarredona, Teresa ;
Linares-Barranco, Bernabe .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2012, 47 (02) :504-517
[8]  
Chen SS, 2005, IEEE INT SYMP CIRC S, P5306
[9]   A spatial contrast retina with on-chip calibration for neuromorphic spike-based AER vision systems [J].
Costas-Santos, Jesus ;
Serrano-Gotarredona, Teresa ;
Serrano-Gotarredona, Rafael ;
Linares-Barranco, Bernabe .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2007, 54 (07) :1444-1458
[10]   A biomorphic digital image sensor [J].
Culurciello, E ;
Etienne-Cummings, R ;
Boahen, KA .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2003, 38 (02) :281-294