Global-Local Convolution with Spiking Neural Networks for Energy-efficient Keyword Spotting

被引:0
作者
Wang, Shuai [1 ]
Zhang, Dehao [1 ]
Shi, Kexin [1 ]
Wang, Yuchen [1 ]
Wei, Wenjie [1 ]
Wu, Jibin [2 ]
Zhang, Malu [1 ]
机构
[1] Univ Elect Sci & Technol China, Chengdu, Sichuan, Peoples R China
[2] Hong Kong Polytech Univ, Hong Kong, Peoples R China
来源
INTERSPEECH 2024 | 2024年
基金
美国国家科学基金会;
关键词
Keyword spotting; Spiking neural networks; Global-Local spiking convolution;
D O I
10.21437/Interspeech.2024-642
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Thanks to Deep Neural Networks (DNNs), the accuracy of Keyword Spotting (KWS) has made substantial progress. However, as KWS systems are usually implemented on edge devices, energy efficiency becomes a critical requirement besides performance. Here, we take advantage of spiking neural networks' energy efficiency and propose an end-to-end lightweight KWS model. The model consists of two innovative modules: 1) Global-Local Spiking Convolution (GLSC) module and 2) Bottleneck-PLIF module. Compared to the hand-crafted feature extraction methods, the GLSC module achieves speech feature extraction that is sparser, more energy-efficient, and yields better performance. The Bottleneck-PLIF module further processes the signals from GLSC with the aim to achieve higher accuracy with fewer parameters. Extensive experiments are conducted on the Google Speech Commands Dataset (V1 and V2). The results show our method achieves competitive performance among SNN-based KWS models with fewer parameters.
引用
收藏
页码:4523 / 4527
页数:5
相关论文
共 50 条
[41]   Energy-Efficient Wireless Technology Recognition Method Using Time-Frequency Feature Fusion Spiking Neural Networks [J].
Hu, Lifan ;
Wang, Yu ;
Fu, Xue ;
Guo, Lantu ;
Lin, Yun ;
Gui, Guan .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2025, 20 :2252-2265
[42]   Thanos: Energy-Efficient Keyword Spotting Processor with Hybrid Time-Feature-Frequency-Domain Zero-Skipping [J].
Kim, Sangyeon ;
Kim, Hyunmin ;
Ryu, Sungju .
2025 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE, DATE, 2025,
[43]   A Hybrid Spiking Neural Network Reinforcement Learning Agent for Energy-Efficient Object Manipulation [J].
Oikonomou, Katerina Maria ;
Kansizoglou, Ioannis ;
Gasteratos, Antonios .
MACHINES, 2023, 11 (02)
[44]   Efficient Structure Slimming for Spiking Neural Networks [J].
Li Y. ;
Fang X. ;
Gao Y. ;
Zhou D. ;
Shen J. ;
Liu J.K. ;
Pan G. ;
Xu Q. .
IEEE Transactions on Artificial Intelligence, 2024, 5 (08) :3823-3831
[45]   Why Spiking Neural Networks Are Efficient: A Theorem [J].
Beer, Michael ;
Urenda, Julio ;
Kosheleva, Olga ;
Kreinovich, Vladik .
INFORMATION PROCESSING AND MANAGEMENT OF UNCERTAINTY IN KNOWLEDGE-BASED SYSTEMS, IPMU 2020, PT I, 2020, 1237 :59-69
[46]   SparkXD: A Framework for Resilient and Energy-Efficient Spiking Neural Network Inference using Approximate DRAM [J].
Putra, Rachmad Vidya Wicaksana ;
Hanif, Muhammad Abdullah ;
Shafique, Muhammad .
2021 58TH ACM/IEEE DESIGN AUTOMATION CONFERENCE (DAC), 2021, :379-384
[47]   Resource-efficient DNNs for Keyword Spotting using Neural Architecture Search and Quantization [J].
Peter, David ;
Roth, Wolfgang ;
Pernkopf, Franz .
2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, :9273-9279
[48]   Exploiting High Performance Spiking Neural Networks With Efficient Spiking Patterns [J].
Shen, Guobin ;
Zhao, Dongcheng ;
Zeng, Yi .
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2025, 9 (02) :1480-1489
[49]   A Depthwise Separable Convolution Neural Network for Small-footprint Keyword Spotting Using Approximate MAC Unit and Streaming Convolution Reuse [J].
Lu, Yicheng ;
Shan, Weiwei ;
Xu, Jiaming .
2019 IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS (APCCAS 2019), 2019, :309-312
[50]   Non-Uniform Boosted MCE Training of Deep Neural Networks for Keyword Spotting [J].
Meng, Zhong ;
Juang, Biing-Hwang .
17TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2016), VOLS 1-5: UNDERSTANDING SPEECH PROCESSING IN HUMANS AND MACHINES, 2016, :770-774