Event-Based Feature Extraction Using Adaptive Selection Thresholds

被引:25
作者
Afshar, Saeed [1 ]
Ralph, Nicholas [1 ]
Xu, Ying [1 ]
Tapson, Jonathan [1 ]
van Schaik, Andre [1 ]
Cohen, Gregory [1 ]
机构
[1] Western Sydney Univ, Int Ctr Neuromorph Engn, MARCS Inst, Werrington, NSW 2747, Australia
关键词
feature extraction; event-based processing; neuromorphic; event-based vision; FEAST; SPIKING;
D O I
10.3390/s20061600
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Unsupervised feature extraction algorithms form one of the most important building blocks in machine learning systems. These algorithms are often adapted to the event-based domain to perform online learning in neuromorphic hardware. However, not designed for the purpose, such algorithms typically require significant simplification during implementation to meet hardware constraints, creating trade offs with performance. Furthermore, conventional feature extraction algorithms are not designed to generate useful intermediary signals which are valuable only in the context of neuromorphic hardware limitations. In this work a novel event-based feature extraction method is proposed that focuses on these issues. The algorithm operates via simple adaptive selection thresholds which allow a simpler implementation of network homeostasis than previous works by trading off a small amount of information loss in the form of missed events that fall outside the selection thresholds. The behavior of the selection thresholds and the output of the network as a whole are shown to provide uniquely useful signals indicating network weight convergence without the need to access network weights. A novel heuristic method for network size selection is proposed which makes use of noise events and their feature representations. The use of selection thresholds is shown to produce network activation patterns that predict classification accuracy allowing rapid evaluation and optimization of system parameters without the need to run back-end classifiers. The feature extraction method is tested on both the N-MNIST (Neuromorphic-MNIST) benchmarking dataset and a dataset of airplanes passing through the field of view. Multiple configurations with different classifiers are tested with the results quantifying the resultant performance gains at each processing stage.
引用
收藏
页数:24
相关论文
共 50 条
[1]   Investigation of Event-Based Surfaces for High-Speed Detection, Unsupervised Feature Extraction, and Object Recognition [J].
Afshar, Saeed ;
Hamilton, Tara Julia ;
Tapson, Jonathan ;
van Schaik, Andre ;
Cohen, Gregory .
FRONTIERS IN NEUROSCIENCE, 2019, 12
[2]   Turn Down That Noise: Synaptic Encoding of Afferent SNR in a Single Spiking Neuron [J].
Afshar, Saeed ;
George, Libin ;
Thakur, Chetan Singh ;
Tapson, Jonathan ;
van Schaik, Andre ;
de Chazal, Philip ;
Hamilton, Tara Julia .
IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, 2015, 9 (02) :188-196
[3]  
[Anonymous], 2014, FRONT NEUROSCI-SWITZ, DOI 10.3389/fnins.2014.00377
[4]  
[Anonymous], 2017, P ADV MAUI OPT SPAC
[5]   Dynamic coding of signed quantities in cortical feedback circuits [J].
Ballard, Dana H. ;
Jehee, Janneke .
FRONTIERS IN PSYCHOLOGY, 2012, 3
[6]   A Dataset for Visual Navigation with Neuromorphic Methods [J].
Barranco, Francisco ;
Fermuller, Cornelia ;
Aloimonos, Yiannis ;
Delbruck, Tobi .
FRONTIERS IN NEUROSCIENCE, 2016, 10
[7]   Event-Based Visual Flow [J].
Benosman, Ryad ;
Clercq, Charles ;
Lagorce, Xavier ;
Ieng, Sio-Hoi ;
Bartolozzi, Chiara .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2014, 25 (02) :407-417
[8]   Point-to-point connectivity between neuromorphic chips using address events [J].
Boahen, KA .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2000, 47 (05) :416-434
[9]   ELiSeD - An Event-Based Line Segment Detector [J].
Brandli, Christian ;
Strubel, Jonas ;
Keller, Susanne ;
Scaramuzza, Davide ;
Delbruck, Tobi .
2016 2ND INTERNATIONAL CONFERENCE ON EVENT-BASED CONTROL, COMMUNICATION, AND SIGNAL PROCESSING (EBCCSP), 2016,
[10]   A 240 x 180 130 dB 3 μs Latency Global Shutter Spatiotemporal Vision Sensor [J].
Brandli, Christian ;
Berner, Raphael ;
Yang, Minhao ;
Liu, Shih-Chii ;
Delbruck, Tobi .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2014, 49 (10) :2333-2341