Event-Based Visual Flow

被引:270
作者
Benosman, Ryad [1 ,2 ]
Clercq, Charles [3 ]
Lagorce, Xavier [1 ]
Ieng, Sio-Hoi [1 ]
Bartolozzi, Chiara [3 ]
机构
[1] Univ Paris 06, Inst Vis, F-75252 Paris 05, France
[2] Univ Genoa, DIST, I-16121 Genoa, Italy
[3] Ist Italiano Tecnol, Dept Robot, I-16163 Genoa, Italy
关键词
Event-based vision; event-based visual motion flow; neuromorphic sensors; real time; OPTICAL-FLOW; DRIVEN;
D O I
10.1109/TNNLS.2013.2273537
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper introduces a new methodology to compute dense visual flow using the precise timings of spikes from an asynchronous event-based retina. Biological retinas, and their artificial counterparts, are totally asynchronous and data-driven and rely on a paradigm of light acquisition radically different from most of the currently used frame-grabber technologies. This paper introduces a framework to estimate visual flow from the local properties of events' spatiotemporal space. We will show that precise visual flow orientation and amplitude can be estimated using a local differential approach on the surface defined by coactive events. Experimental results are presented; they show the method adequacy with high data sparseness and temporal resolution of event-based acquisition that allows the computation of motion flow with microsecond accuracy and at very low computational cost.
引用
收藏
页码:407 / 417
页数:11
相关论文
共 34 条
  • [1] A COMPUTATIONAL FRAMEWORK AND AN ALGORITHM FOR THE MEASUREMENT OF VISUAL-MOTION
    ANANDAN, P
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 1989, 2 (03) : 283 - 310
  • [2] [Anonymous], 1988, International journal of computer vision
  • [3] A 3.6 μs Latency Asynchronous Frame-Free Event-Driven Dynamic-Vision-Sensor
    Antonio Lenero-Bardallo, Juan
    Serrano-Gotarredona, Teresa
    Linares-Barranco, Bernabe
    [J]. IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2011, 46 (06) : 1443 - 1455
  • [4] Fast Vision Through Frameless Event-Based Sensing and Convolutional Processing: Application to Texture Recognition
    Antonio Perez-Carrasco, Jose
    Acha, Begona
    Serrano, Carmen
    Camunas-Mesa, Luis
    Serrano-Gotarredona, Teresa
    Linares-Barranco, Bernabe
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2010, 21 (04): : 609 - 620
  • [5] Could information theory provide an ecological theory of sensory processing?
    Aticky, Joseph J.
    [J]. NETWORK-COMPUTATION IN NEURAL SYSTEMS, 2011, 22 (1-4) : 4 - 44
  • [6] Quantitative evaluation of matching methods and validity measures for stereo vision
    Banks, J
    Corke, P
    [J]. INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2001, 20 (07) : 512 - 532
  • [7] BARLOW HB, 1969, J PHYSIOL-LONDON, V200, P1
  • [8] PERFORMANCE OF OPTICAL-FLOW TECHNIQUES
    BARRON, JL
    FLEET, DJ
    BEAUCHEMIN, SS
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 1994, 12 (01) : 43 - 77
  • [9] Asynchronous frameless event-based optical flow
    Benosman, Ryad
    Ieng, Sio-Hoi
    Clercq, Charles
    Bartolozzi, Chiara
    Srinivasan, Mandyam
    [J]. NEURAL NETWORKS, 2012, 27 : 32 - 37
  • [10] Asynchronous Event-Based Hebbian Epipolar Geometry
    Benosman, Ryad
    Ieng, Sio-Hoi
    Rogister, Paul
    Posch, Christoph
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2011, 22 (11): : 1723 - 1734