Event-Based Visual Flow

被引:294
作者
Benosman, Ryad [1 ,2 ]
Clercq, Charles [3 ]
Lagorce, Xavier [1 ]
Ieng, Sio-Hoi [1 ]
Bartolozzi, Chiara [3 ]
机构
[1] Univ Paris 06, Inst Vis, F-75252 Paris 05, France
[2] Univ Genoa, DIST, I-16121 Genoa, Italy
[3] Ist Italiano Tecnol, Dept Robot, I-16163 Genoa, Italy
关键词
Event-based vision; event-based visual motion flow; neuromorphic sensors; real time; OPTICAL-FLOW; DRIVEN;
D O I
10.1109/TNNLS.2013.2273537
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper introduces a new methodology to compute dense visual flow using the precise timings of spikes from an asynchronous event-based retina. Biological retinas, and their artificial counterparts, are totally asynchronous and data-driven and rely on a paradigm of light acquisition radically different from most of the currently used frame-grabber technologies. This paper introduces a framework to estimate visual flow from the local properties of events' spatiotemporal space. We will show that precise visual flow orientation and amplitude can be estimated using a local differential approach on the surface defined by coactive events. Experimental results are presented; they show the method adequacy with high data sparseness and temporal resolution of event-based acquisition that allows the computation of motion flow with microsecond accuracy and at very low computational cost.
引用
收藏
页码:407 / 417
页数:11
相关论文
共 34 条
[1]   A COMPUTATIONAL FRAMEWORK AND AN ALGORITHM FOR THE MEASUREMENT OF VISUAL-MOTION [J].
ANANDAN, P .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1989, 2 (03) :283-310
[2]  
[Anonymous], 1988, International journal of computer vision
[3]   A 3.6 μs Latency Asynchronous Frame-Free Event-Driven Dynamic-Vision-Sensor [J].
Antonio Lenero-Bardallo, Juan ;
Serrano-Gotarredona, Teresa ;
Linares-Barranco, Bernabe .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2011, 46 (06) :1443-1455
[4]   Fast Vision Through Frameless Event-Based Sensing and Convolutional Processing: Application to Texture Recognition [J].
Antonio Perez-Carrasco, Jose ;
Acha, Begona ;
Serrano, Carmen ;
Camunas-Mesa, Luis ;
Serrano-Gotarredona, Teresa ;
Linares-Barranco, Bernabe .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2010, 21 (04) :609-620
[5]   Could information theory provide an ecological theory of sensory processing? [J].
Aticky, Joseph J. .
NETWORK-COMPUTATION IN NEURAL SYSTEMS, 2011, 22 (1-4) :4-44
[6]   Quantitative evaluation of matching methods and validity measures for stereo vision [J].
Banks, J ;
Corke, P .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2001, 20 (07) :512-532
[7]  
BARLOW HB, 1969, J PHYSIOL-LONDON, V200, P1
[8]   PERFORMANCE OF OPTICAL-FLOW TECHNIQUES [J].
BARRON, JL ;
FLEET, DJ ;
BEAUCHEMIN, SS .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1994, 12 (01) :43-77
[9]   Asynchronous frameless event-based optical flow [J].
Benosman, Ryad ;
Ieng, Sio-Hoi ;
Clercq, Charles ;
Bartolozzi, Chiara ;
Srinivasan, Mandyam .
NEURAL NETWORKS, 2012, 27 :32-37
[10]   Asynchronous Event-Based Hebbian Epipolar Geometry [J].
Benosman, Ryad ;
Ieng, Sio-Hoi ;
Rogister, Paul ;
Posch, Christoph .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2011, 22 (11) :1723-1734