Efficiency metrics for auditory neuromorphic spike encoding techniques using information theory

被引:2
作者
El Ferdaoussi, Ahmad [1 ]
Rouat, Jean [1 ]
Plourde, Eric [1 ]
机构
[1] Univ Sherbrooke, Dept Elect & Comp Engn, NECOTIS, Sherbrooke, PQ J1K 2R1, Canada
来源
NEUROMORPHIC COMPUTING AND ENGINEERING | 2023年 / 3卷 / 02期
基金
加拿大自然科学与工程研究理事会;
关键词
audio signal processing; neural coding; spike encoding; spiking neural networks; mutual information; BIAS;
D O I
10.1088/2634-4386/acd952
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Spike encoding of sound consists in converting a sound waveform into spikes. It is of interest in many domains, including the development of audio-based spiking neural network applications, where it is the first and a crucial stage of processing. Many spike encoding techniques exist, but there is no systematic approach to quantitatively evaluate their performance. This work proposes the use of three efficiency metrics based on information theory to solve this problem. The first, coding efficiency, measures the fraction of information that the spikes encode on the amplitude of the input signal. The second, computational efficiency, measures the information encoded subject to abstract computational costs imposed on the algorithmic operations of the spike encoding technique. The third, energy efficiency, measures the actual energy expended in the implementation of a spike encoding task. These three efficiency metrics are used to evaluate the performance of four spike encoding techniques for sound on the encoding of a cochleagram representation of speech data. The spike encoding techniques are: Independent Spike Coding, Send-on-Delta coding, Ben's Spiker Algorithm, and Leaky Integrate-and-Fire (LIF) coding. The results show that LIF coding has the overall best performance in terms of coding, computational, and energy efficiency.
引用
收藏
页数:14
相关论文
共 47 条
[1]  
Bellec G, 2018, 32 C NEURAL INFORM P
[2]   Information theory and neural coding [J].
Borst, A ;
Theunissen, FE .
NATURE NEUROSCIENCE, 1999, 2 (11) :947-957
[3]   A MODEL FOR THE RESPONSES OF LOW-FREQUENCY AUDITORY-NERVE FIBERS IN CAT [J].
CARNEY, LH .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1993, 93 (01) :401-417
[4]  
Cover T. M., 1999, Elements of Information Theory
[5]   The Heidelberg Spiking Data Sets for the Systematic Evaluation of Spiking Neural Networks [J].
Cramer, Benjamin ;
Stradmann, Yannik ;
Schemmel, Johannes ;
Zenke, Friedemann .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (07) :2744-2757
[6]   A toolbox for neuromorphic perception in robotics [J].
Dupeyroux, Julien ;
Stroobants, Stein ;
de Croon, Guido C. H. E. .
2022 8TH INTERNATIONAL CONFERENCE ON EVENT-BASED CONTROL, COMMUNICATION AND SIGNAL PROCESSING (EBCCSP 2022), 2022,
[7]  
El Ferdaoussi A, 2022, Arxiv, DOI arXiv:2202.09619
[8]  
Fog A., 2022, Instruction tables Technical University of Denmark
[9]   Spike encoding techniques for IoT time-varying signals benchmarked on a neuromorphic classification task [J].
Forno, Evelina ;
Fra, Vittorio ;
Pignari, Riccardo ;
Macii, Enrico ;
Urgese, Gianvito .
FRONTIERS IN NEUROSCIENCE, 2022, 16
[10]  
Gary Leonard R., 1993, Tidigits ldc93-10