Event based visual attention with dynamic neural field on FPGA

被引:2
作者
de Vangel, Benoit Chappet [1 ]
Torres-Huitzil, Cesar [2 ]
Girau, Bernard [1 ]
机构
[1] Univ Lorraine, LORIA, Nancy, France
[2] Cinvestav Tamaulipas, Mexico City, DF, Mexico
来源
ICDSC 2016: 10TH INTERNATIONAL CONFERENCE ON DISTRIBUTED SMART CAMERA | 2016年
关键词
Dynamic Neural Field; Visual attention; FPGA; DVS;
D O I
10.1145/2967413.2967443
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Dynamic Field Theory (DFT) is an established framework for neuro-modeling or neuro-inspired computing, well suited for challenging perception and motion related tasks. However, their computational requirements, distributed storage and bandwidth needs make them difficult to design for real-world environments. In this paper, the digital hardware implementation of an event-based dynamic neural field for object tracking and attention is presented. To make computation less complex and hardware-friendly, some optimization on the weights and the neuron model were conducted on the Dynamic Neural Field (DNF) model under a spiking-based computation approach. In a proof-of-concept prototype we show how this derived Spiking DNF (SDNF) core can be interfaced to a Dynamic Vision Sensor (DVS) silicon retina and integrated into a more complex architecture able to perform selective attention.
引用
收藏
页码:142 / 147
页数:6
相关论文
共 16 条
[1]   DYNAMICS OF PATTERN FORMATION IN LATERAL-INHIBITION TYPE NEURAL FIELDS [J].
AMARI, SI .
BIOLOGICAL CYBERNETICS, 1977, 27 (02) :77-87
[2]  
Chevallier S., 2008, EUR S ART NEUR NETW, P385
[3]  
de Vangel B. C., 2016, 2016 INT JOINT C NEU
[4]   Optimal sensorimotor integration in recurrent cortical networks:: A neural implementation of Kalman filters [J].
Deneve, Sophie ;
Duhamel, Jean-Rene ;
Pouget, Alexandre .
JOURNAL OF NEUROSCIENCE, 2007, 27 (21) :5744-5756
[5]  
Ester M., 1996, KDD-96 Proceedings. Second International Conference on Knowledge Discovery and Data Mining, P226
[6]   Asynchronous Event-based Cooperative Stereo Matching Using Neuromorphic Silicon Retinas [J].
Firouzi, Mohsen ;
Conradt, Joerg .
NEURAL PROCESSING LETTERS, 2016, 43 (02) :311-326
[7]   Template based black-box optimization of dynamic neural fields [J].
Fix, Jeremy .
NEURAL NETWORKS, 2013, 46 :40-49
[8]  
Giese, 2012, DYNAMIC NEURAL FIELD, V469
[9]  
Kubota S., 2004, MATH ENG TECHNICAL R
[10]   A 128x128 120 dB 15 μs latency asynchronous temporal contrast vision sensor [J].
Lichtsteiner, Patrick ;
Posch, Christoph ;
Delbruck, Tobi .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2008, 43 (02) :566-576