Global-Local Convolution with Spiking Neural Networks for Energy-efficient Keyword Spotting

被引:0
作者
Wang, Shuai [1 ]
Zhang, Dehao [1 ]
Shi, Kexin [1 ]
Wang, Yuchen [1 ]
Wei, Wenjie [1 ]
Wu, Jibin [2 ]
Zhang, Malu [1 ]
机构
[1] Univ Elect Sci & Technol China, Chengdu, Sichuan, Peoples R China
[2] Hong Kong Polytech Univ, Hong Kong, Peoples R China
来源
INTERSPEECH 2024 | 2024年
基金
美国国家科学基金会;
关键词
Keyword spotting; Spiking neural networks; Global-Local spiking convolution;
D O I
10.21437/Interspeech.2024-642
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Thanks to Deep Neural Networks (DNNs), the accuracy of Keyword Spotting (KWS) has made substantial progress. However, as KWS systems are usually implemented on edge devices, energy efficiency becomes a critical requirement besides performance. Here, we take advantage of spiking neural networks' energy efficiency and propose an end-to-end lightweight KWS model. The model consists of two innovative modules: 1) Global-Local Spiking Convolution (GLSC) module and 2) Bottleneck-PLIF module. Compared to the hand-crafted feature extraction methods, the GLSC module achieves speech feature extraction that is sparser, more energy-efficient, and yields better performance. The Bottleneck-PLIF module further processes the signals from GLSC with the aim to achieve higher accuracy with fewer parameters. Extensive experiments are conducted on the Google Speech Commands Dataset (V1 and V2). The results show our method achieves competitive performance among SNN-based KWS models with fewer parameters.
引用
收藏
页码:4523 / 4527
页数:5
相关论文
共 50 条
[31]   SNN4Agents: a framework for developing energy-efficient embodied spiking neural networks for autonomous agents [J].
Putra, Rachmad Vidya Wicaksana ;
Marchisio, Alberto ;
Shafique, Muhammad .
FRONTIERS IN ROBOTICS AND AI, 2024, 11
[32]   Efficient Hardware Implementation for Online Local Learning in Spiking Neural Networks [J].
Guo, Wenzhe ;
Fouda, Mohammed E. ;
Eltawil, Ahmed M. ;
Salama, Khaled Nabil .
2022 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS 2022): INTELLIGENT TECHNOLOGY IN THE POST-PANDEMIC ERA, 2022, :387-390
[33]   Energy-friendly keyword spotting system using add-based convolution [J].
Zhou, Hang ;
Hu, Wenchao ;
Yeung, Yu Ting ;
Chen, Xiao .
INTERSPEECH 2021, 2021, :4234-4238
[34]   SMALL-FOOTPRINT KEYWORD SPOTTING USING DEEP NEURAL NETWORKS [J].
Chen, Guoguo ;
Parada, Carolina ;
Heigold, Georg .
2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
[35]   Convolutional Recurrent Neural Networks for Small-Footprint Keyword Spotting [J].
Arik, Sercan O. ;
Kliegl, Markus ;
Child, Rewon ;
Hestness, Joel ;
Gibiansky, Andrew ;
Fougner, Chris ;
Prenger, Ryan ;
Coates, Adam .
18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION, 2017, :1606-1610
[36]   Evaluating Robustness to Noise and Compression of Deep Neural Networks for Keyword Spotting [J].
Pereira, Pedro H. ;
Beccaro, Wesley ;
Ramirez, Miguel A. .
IEEE ACCESS, 2023, 11 :53224-53236
[37]   AN EXPERIMENTAL ANALYSIS OF THE POWER CONSUMPTION OF CONVOLUTIONAL NEURAL NETWORKS FOR KEYWORD SPOTTING [J].
Tang, Raphael ;
Wang, Weijie ;
Tu, Zhucheng ;
Lin, Jimmy .
2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, :5479-5483
[38]   On Reducing Activity with Distillation and Regularization for Energy Efficient Spiking Neural Networks [J].
Louis, Thomas ;
Pegatoquet, Alain ;
Miramond, Benoit ;
Girard, Adrien .
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING-ICANN 2024, PT X, 2024, 15025 :407-421
[39]   Sparsity Enables Data and Energy Efficient Spiking Convolutional Neural Networks [J].
Bhatt, Varun ;
Ganguly, Udayan .
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2018, PT I, 2018, 11139 :263-272
[40]   Reset-dominant accurate synaptic weight mapping in passive memristor arrays for energy-efficient spiking neural networks [J].
Byun, Yongjin ;
Kim, Gimun ;
Kim, Sungjoon ;
Kim, Sungjun .
NANO ENERGY, 2025, 142