MatchboxNet: 1D Time-Channel Separable Convolutional Neural Network Architecture for Speech Commands Recognition

被引:33
作者
Majumdar, Somshubra [1 ]
Ginsburg, Boris [1 ]
机构
[1] NVIDIA, Santa Clara, CA 95051 USA
来源
INTERSPEECH 2020 | 2020年
关键词
key word spotting; speech commands recognition; deep neural networks; depth-wise separable convolution;
D O I
10.21437/Interspeech.2020-1058
中图分类号
R36 [病理学]; R76 [耳鼻咽喉科学];
学科分类号
100104 ; 100213 ;
摘要
We present MatchboxNet - an end-to-end neural network for speech command recognition. MatchboxNet is a deep residual network composed from blocks of 1D time-channel separable convolution, batch-normalization, ReLU and dropout layers. MatchboxNet reaches state-of-the art accuracy on the Google Speech Commands dataset while having significantly fewer parameters than similar models. The small footprint of MatchboxNet makes it an attractive candidate for devices with limited computational resources. The model is highly scalable, so model accuracy can be improved with modest additional memory and compute. Finally, we show how intensive data augmentation using an auxiliary noise dataset improves robustness in the presence of background noise.
引用
收藏
页码:3356 / 3360
页数:5
相关论文
共 34 条
[1]  
[Anonymous], 2016, IEEE W SP LANG TECH
[2]  
[Anonymous], 2016, PROCEEDINGS, DOI DOI 10.1109/CVPR.2016.90
[3]  
[Anonymous], 2017, ARXIV170305390
[4]  
[Anonymous], 2018, A neural attention model for speech command recognition
[5]  
[Anonymous], 2018, Mixed precision training
[6]   GLOBAL OPTIMIZATION OF A NEURAL NETWORK-HIDDEN MARKOV MODEL HYBRID [J].
BENGIO, Y ;
DEMORI, R ;
FLAMMIA, G ;
KOMPE, R .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1992, 3 (02) :252-259
[7]  
Choi S., 2019, ARXIV190403814, P3372
[8]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[9]  
Coucke A, 2019, INT CONF ACOUST SPEE, P6351, DOI 10.1109/ICASSP.2019.8683474
[10]  
DeVries T., 2017, Improved regulariza