Asynchronous event-based corner detection and matching

被引:77
作者
Clady, Xavier [1 ]
Ieng, Sio-Hoi [1 ]
Benosman, Ryad [1 ]
机构
[1] Univ Paris 06, Vis Inst, Paris, France
关键词
Neuromorphic sensor; Event-based vision; Corner detection and matching; Intersection of constraints; INTEREST POINT DETECTORS; PERFORMANCE EVALUATION; DESCRIPTORS; FEATURES; DRIVEN; SYSTEMS;
D O I
10.1016/j.neunet.2015.02.013
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper introduces an event-based luminance-free method to detect and match corner events from the output of asynchronous event-based neuromorphic retinas. The method relies on the use of space time properties of moving edges. Asynchronous event-based neuromorphic retinas are composed of autonomous pixels, each of them asynchronously generating "spiking" events that encode relative changes in pixels' illumination at high temporal resolutions. Corner events are defined as the spatiotemporal locations where the aperture problem can be solved using the intersection of several geometric constraints in events' spatiotemporal spaces. A regularization process provides the required constraints, i.e. the motion attributes of the edges with respect to their spatiotemporal locations using local geometric properties of visual events. Experimental results are presented on several real scenes showing the stability and robustness of the detection and matching. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:91 / 106
页数:16
相关论文
共 37 条
[1]   PHENOMENAL COHERENCE OF MOVING VISUAL-PATTERNS [J].
ADELSON, EH ;
MOVSHON, JA .
NATURE, 1982, 300 (5892) :523-525
[2]   What Can Neuromorphic Event-Driven Precise Timing Add to Spike-Based Pattern Recognition? [J].
Akolkar, Himanshu ;
Meyer, Cedric ;
Clady, Zavier ;
Marre, Olivier ;
Bartolozzi, Chiara ;
Panzeri, Stefano ;
Benosman, Ryad .
NEURAL COMPUTATION, 2015, 27 (03) :561-593
[3]  
[Anonymous], CMURITR8003 CARN MEL
[4]   Mapping from Frame-Driven to Frame-Free Event-Driven Vision Systems by Low-Rate Rate Coding and Coincidence Processing-Application to Feedforward ConvNets [J].
Antonio Perez-Carrasco, Jose ;
Zhao, Bo ;
Serrano, Carmen ;
Acha, Begona ;
Serrano-Gotarredona, Teresa ;
Chen, Shouchun ;
Linares-Barranco, Bernabe .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (11) :2706-2719
[5]   Event-Based Visual Flow [J].
Benosman, Ryad ;
Clercq, Charles ;
Lagorce, Xavier ;
Ieng, Sio-Hoi ;
Bartolozzi, Chiara .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2014, 25 (02) :407-417
[6]   A comprehensive workflow for general-purpose neural modeling with highly configurable neuromorphic hardware systems [J].
Bruederle, Daniel ;
Petrovici, Mihai A. ;
Vogginger, Bernhard ;
Ehrlich, Matthias ;
Pfeil, Thomas ;
Millner, Sebastian ;
Gruebl, Andreas ;
Wendt, Karsten ;
Mueller, Eric ;
Schwartz, Marc-Olivier ;
de Oliveira, Dan Husmann ;
Jeltsch, Sebastian ;
Fieres, Johannes ;
Schilling, Moritz ;
Mueller, Paul ;
Breitwieser, Oliver ;
Petkov, Venelin ;
Muller, Lyle ;
Davison, Andrew P. ;
Krishnamurthy, Pradeep ;
Kremkow, Jens ;
Lundqvist, Mikael ;
Muller, Eilif ;
Partzsch, Johannes ;
Scholze, Stefan ;
Zuehl, Lukas ;
Mayr, Christian ;
Destexhe, Alain ;
Diesmann, Markus ;
Potjans, Tobias C. ;
Lansner, Anders ;
Schueffny, Rene ;
Schemmel, Johannes ;
Meier, Karlheinz .
BIOLOGICAL CYBERNETICS, 2011, 104 (4-5) :263-296
[7]  
Delbrück T, 2010, IEEE INT SYMP CIRC S, P2426, DOI 10.1109/ISCAS.2010.5537149
[8]   Features for image retrieval: an experimental comparison [J].
Deselaers, Thomas ;
Keysers, Daniel ;
Ney, Hermann .
INFORMATION RETRIEVAL, 2008, 11 (02) :77-107
[9]   Coding Images with Local Features [J].
Dickscheid, Timo ;
Schindler, Falko ;
Foerstner, Wolfgang .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2011, 94 (02) :154-174
[10]   Overview of the SpiNNaker System Architecture [J].
Furber, Steve B. ;
Lester, David R. ;
Plana, Luis A. ;
Garside, Jim D. ;
Painkras, Eustace ;
Temple, Steve ;
Brown, Andrew D. .
IEEE TRANSACTIONS ON COMPUTERS, 2013, 62 (12) :2454-2467