MatchboxNet: 1D Time-Channel Separable Convolutional Neural Network Architecture for Speech Commands Recognition

被引:33
作者
Majumdar, Somshubra [1 ]
Ginsburg, Boris [1 ]
机构
[1] NVIDIA, Santa Clara, CA 95051 USA
来源
INTERSPEECH 2020 | 2020年
关键词
key word spotting; speech commands recognition; deep neural networks; depth-wise separable convolution;
D O I
10.21437/Interspeech.2020-1058
中图分类号
R36 [病理学]; R76 [耳鼻咽喉科学];
学科分类号
100104 ; 100213 ;
摘要
We present MatchboxNet - an end-to-end neural network for speech command recognition. MatchboxNet is a deep residual network composed from blocks of 1D time-channel separable convolution, batch-normalization, ReLU and dropout layers. MatchboxNet reaches state-of-the art accuracy on the Google Speech Commands dataset while having significantly fewer parameters than similar models. The small footprint of MatchboxNet makes it an attractive candidate for devices with limited computational resources. The model is highly scalable, so model accuracy can be improved with modest additional memory and compute. Finally, we show how intensive data augmentation using an auxiliary noise dataset improves robustness in the presence of background noise.
引用
收藏
页码:3356 / 3360
页数:5
相关论文
共 34 条
[11]  
Font F., 2013, P 21 ACM INT C MULT, P411, DOI 10.1145/2502081.2502245
[12]  
Ginsburg B., 2020, Stochastic Gradient Methods With Layer-Wise Adaptive Moments for Training of Deep Networks
[13]   Framewise phoneme classification with bidirectional LSTM and other neural network architectures [J].
Graves, A ;
Schmidhuber, J .
NEURAL NETWORKS, 2005, 18 (5-6) :602-610
[14]  
Graves A., 2004, BIOL INSPIRED APPROA
[15]   Bag of Tricks for Image Classification with Convolutional Neural Networks [J].
He, Tong ;
Zhang, Zhi ;
Zhang, Hang ;
Zhang, Zhongyue ;
Xie, Junyuan ;
Li, Mu .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :558-567
[16]  
He YZ, 2019, INT CONF ACOUST SPEE, P6381, DOI [10.1109/icassp.2019.8682336, 10.1109/ICASSP.2019.8682336]
[17]  
Hermansky H, 2000, INT CONF ACOUST SPEE, P1635, DOI 10.1109/ICASSP.2000.862024
[18]   Deep Neural Networks for Acoustic Modeling in Speech Recognition [J].
Hinton, Geoffrey ;
Deng, Li ;
Yu, Dong ;
Dahl, George E. ;
Mohamed, Abdel-rahman ;
Jaitly, Navdeep ;
Senior, Andrew ;
Vanhoucke, Vincent ;
Patrick Nguyen ;
Sainath, Tara N. ;
Kingsbury, Brian .
IEEE SIGNAL PROCESSING MAGAZINE, 2012, 29 (06) :82-97
[19]   Densely Connected Convolutional Networks [J].
Huang, Gao ;
Liu, Zhuang ;
van der Maaten, Laurens ;
Weinberger, Kilian Q. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2261-2269
[20]  
Kaiser L., 2017, ARXIV170603059