Asynchronous Event-Based Fourier Analysis

被引:18
作者
Sabatier, Quentin [1 ,2 ,3 ,4 ]
Ieng, Sio-Hoi [1 ,2 ,3 ]
Benosman, Ryad [1 ,2 ,3 ]
机构
[1] UPMC Univ Paris 06, Sorbonne Univ, F-75252 Paris, France
[2] Inst Vis, UMR S 968, F-75012 Paris, France
[3] CNRS, UMR 7210, F-75012 Paris, France
[4] Gensight Biol, F-75012 Paris, France
关键词
Address event representation (AER); event-based processing; fast Fourier transform; neuromorphic vision; SIGNAL; PERFORMANCE; VISION; FFT;
D O I
10.1109/TIP.2017.2661702
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper introduces a method to compute the FFT of a visual scene at a high temporal precision of around 1-mu s output from an asynchronous event-based camera. Event-based cameras allow to go beyond the widespread and ingrained belief that acquiring series of images at some rate is a good way to capture visual motion. Each pixel adapts its own sampling rate to the visual input it receives and defines the timing of its own sampling points in response to its visual input by reacting to changes of the amount of incident light. As a consequence, the sampling process is no longer governed by a fixed timing source but by the signal to be sampled itself, or more precisely by the variations of the signal in the amplitude domain. Event-based cameras acquisition paradigm allows to go beyond the current conventional method to compute the FFT. The event-driven FFT algorithm relies on a heuristic methodology designed to operate directly on incoming gray level events to update incrementally the FFT while reducing both computation and data load. We show that for reasonable levels of approximations at equivalent frame rates beyond the millisecond, the method performs faster and more efficiently than conventional image acquisition. Several experiments are carried out on indoor and outdoor scenes where both conventional and event-driven FFT computation is shown and compared.
引用
收藏
页码:2192 / 2202
页数:11
相关论文
共 45 条
[11]   A Pencil Balancing Robot using a Pair of AER Dynamic Vision Sensors [J].
Conradt, J. ;
Cook, M. ;
Berner, R. ;
Lichtsteiner, P. ;
Douglas, R. J. ;
Delbruck, T. .
ISCAS: 2009 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1-5, 2009, :781-784
[12]   Rapid prototyping of large-scale analog circuits with field programmable analog array [J].
Baskaya, Faik ;
Gestner, Brian ;
Twigg, Chris ;
Lim, Sung Kyu ;
Anderson, David V. ;
Hasler, Paul .
FCCM 2007: 15TH ANNUAL IEEE SYMPOSIUM ON FIELD-PROGRAMMABLE CUSTOM COMPUTING MACHINES, PROCEEDINGS, 2007, :319-+
[13]  
Dillon T., 2001, CELL J, V41
[14]  
Eng F., 2005, P RADIOVETENSKAP KOM, P1
[15]  
Eng F., 2007, THESIS
[16]   Performance of the 3D FFT on the 6D network torus QCDOC parallel supercomputer [J].
Fang, Bin ;
Deng, Yuefan ;
Martyna, Glenn .
COMPUTER PHYSICS COMMUNICATIONS, 2007, 176 (08) :531-538
[17]   Asynchronous Event-based Cooperative Stereo Matching Using Neuromorphic Silicon Retinas [J].
Firouzi, Mohsen ;
Conradt, Joerg .
NEURAL PROCESSING LETTERS, 2016, 43 (02) :311-326
[18]   Discrete Fourier Transform on Multicore A review of optimizations necessary for good multicore performance [J].
Franchetti, Franz ;
Pueschel, Markus ;
Voronenko, Yevgen ;
Chellappa, Srinivas ;
Moura, Jose M. F. .
IEEE SIGNAL PROCESSING MAGAZINE, 2009, 26 (06) :90-102
[19]  
Frigo M, 1998, INT CONF ACOUST SPEE, P1381, DOI 10.1109/ICASSP.1998.681704
[20]  
Greitans M., 2013, P EUR SIGN PROC C OC, V4, P1