Global-Local Convolution with Spiking Neural Networks for Energy-efficient Keyword Spotting

被引:0
作者
Wang, Shuai [1 ]
Zhang, Dehao [1 ]
Shi, Kexin [1 ]
Wang, Yuchen [1 ]
Wei, Wenjie [1 ]
Wu, Jibin [2 ]
Zhang, Malu [1 ]
机构
[1] Univ Elect Sci & Technol China, Chengdu, Sichuan, Peoples R China
[2] Hong Kong Polytech Univ, Hong Kong, Peoples R China
来源
INTERSPEECH 2024 | 2024年
基金
美国国家科学基金会;
关键词
Keyword spotting; Spiking neural networks; Global-Local spiking convolution;
D O I
10.21437/Interspeech.2024-642
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Thanks to Deep Neural Networks (DNNs), the accuracy of Keyword Spotting (KWS) has made substantial progress. However, as KWS systems are usually implemented on edge devices, energy efficiency becomes a critical requirement besides performance. Here, we take advantage of spiking neural networks' energy efficiency and propose an end-to-end lightweight KWS model. The model consists of two innovative modules: 1) Global-Local Spiking Convolution (GLSC) module and 2) Bottleneck-PLIF module. Compared to the hand-crafted feature extraction methods, the GLSC module achieves speech feature extraction that is sparser, more energy-efficient, and yields better performance. The Bottleneck-PLIF module further processes the signals from GLSC with the aim to achieve higher accuracy with fewer parameters. Extensive experiments are conducted on the Google Speech Commands Dataset (V1 and V2). The results show our method achieves competitive performance among SNN-based KWS models with fewer parameters.
引用
收藏
页码:4523 / 4527
页数:5
相关论文
共 50 条
[21]   Energy-Efficient and Comprehensive Garbage Bin Overflow Detection Model Based on Spiking Neural Networks [J].
Yang, Liwen ;
Zha, Xionghui ;
Huang, Jin ;
Liu, Zhengming ;
Chen, Jiaqi ;
Mou, Chaozhou .
SMART CITIES, 2025, 8 (02)
[22]   ReSpawn: Energy-Efficient Fault-Tolerance for Spiking Neural Networks considering Unreliable Memories [J].
Putra, Rachmad Vidya Wicaksana ;
Hanif, Muhammad Abdullah ;
Shafique, Muhammad .
2021 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER AIDED DESIGN (ICCAD), 2021,
[23]   Efficient Keyword Spotting through Hardware-Aware Conditional Execution of Deep Neural Networks [J].
Giraldo, J. S. P. ;
O'Connor, Chris ;
Verhelst, Marian .
2019 IEEE/ACS 16TH INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS AND APPLICATIONS (AICCSA 2019), 2019,
[24]   SCTN: Event-based object tracking with energy-efficient deep convolutional spiking neural networks [J].
Ji, Mingcheng ;
Wang, Ziling ;
Yan, Rui ;
Liu, Qingjie ;
Xu, Shu ;
Tang, Huajin .
FRONTIERS IN NEUROSCIENCE, 2023, 17
[25]   SpikeDyn: A Framework for Energy-Efficient Spiking Neural Networks with Continual and Unsupervised Learning Capabilities in Dynamic Environments [J].
Putra, Rachmad Vidya Wicaksana ;
Shafique, Muhammad .
2021 58TH ACM/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2021, :1057-1062
[26]   Quantization-Aware Training of Spiking Neural Networks for Energy-Efficient Spectrum Sensing on Loihi Chip [J].
Liu, Shiya ;
Mohammadi, Nima ;
Yi, Yang .
IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2024, 8 (02) :827-838
[27]   A Fully Spiking Hybrid Neural Network for Energy-Efficient Object Detection [J].
Chakraborty, Biswadeep ;
She, Xueyuan ;
Mukhopadhyay, Saibal .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :9014-9029
[28]   Deep Spiking Neural Network for Energy-Efficient SAR Ship Detection [J].
Yoo, Minjung ;
Han, Juhyeon ;
Kim, Sunok .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2025, 22
[29]   Bio-inspired Model Based on Global-Local Hybrid Learning in Spiking Neural Network [J].
Wang, Yuchen ;
Wang, Xiaobin ;
Qu, Hong ;
Zhang, Ya ;
Chen, Yi ;
Luo, Xiaoling .
2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
[30]   Energy-Efficient Models for High-Dimensional Spike Train Classification using Sparse Spiking Neural Networks [J].
Yin, Hang ;
Lee, John Boaz ;
Kong, Xiangnan ;
Hartvigsen, Thomas ;
Xie, Sihong .
KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, :2017-2025