Dop-DenseNet: Densely Convolutional Neural Network-Based Gesture Recognition Using a Micro-Doppler Radar

被引:5
作者
Hai Le [1 ]
Van-Phuc Hoang [1 ]
Van Sang Doan [2 ]
Dai Phong Le [1 ]
机构
[1] Quy Don Tech Univ, Inst Syst Integrat, Hanoi, Vietnam
[2] Vietnam Naval Acad, Nha Trang, Vietnam
来源
JOURNAL OF ELECTROMAGNETIC ENGINEERING AND SCIENCE | 2022年 / 22卷 / 03期
关键词
Convolutional Neural Network; Hand Gesture Recognition; Micro-Doppler Radar;
D O I
10.26866/jees.2022.3.r.95
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Hand gesture recognition is an efficient and practical solution for the non-contact human-machine interaction in smart devices. To date, vision-based methods are widely used in this research area, but they are susceptible to light conditions. To address this issue, radar-based gesture recognition using micro-Doppler signatures can be applied as an alternative. Accordingly, the use of a novel densely convolutional neural network model, Dop-DenseNet, is proposed in this paper for improving hand gesture recognition in terms of classification accuracy and latency. The model was designed with cross or skip connections in a dense architecture so that the former features, which can be lost in the forward-propagation process, can be reused. We evaluated our model with different numbers of filter channels and experimented with it using the Dop-Net dataset, with different time lengths of input data. As a result, it was found that the model with 64 3 x 3 filters and 200 time bins of micro-Doppler spectrogram data could achieve the best performance trade-off, with 99.87% classification accuracy and 3.1 ms latency. In comparison, our model remarkably outperformed the selected state-of-the-art neural networks (GoogLeNet, ResNet-50, NasNet-Mobile, and MobileNet-V2) using the same Dop-Net dataset.
引用
收藏
页码:335 / 343
页数:9
相关论文
共 18 条
[1]   Hand Gestures Recognition Using Radar Sensors for Human-Computer-Interaction: A Review [J].
Ahmed, Shahzad ;
Kallu, Karam Dad ;
Ahmed, Sarfaraz ;
Cho, Sung Ho .
REMOTE SENSING, 2021, 13 (03) :1-24
[2]   Novel Radar-based Gesture Recognition System using Optimized CNN-LSTM Deep Neural Network for Low-power Microcomputer Platform [J].
Chmurski, Mateusz ;
Zubert, Mariusz .
ICAART: PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE - VOL 2, 2021, :882-890
[3]  
Fan ZY, 2020, INT CONF WIRE COMMUN, P522, DOI [10.1109/WCSP49889.2020.9299816, 10.1109/wcsp49889.2020.9299816]
[4]   Dynamic Hand Gesture Recognition Based on 3D Hand Pose Estimation for Human-Robot Interaction [J].
Gao, Qing ;
Chen, Yongquan ;
Ju, Zhaojie ;
Liang, Yi .
IEEE SENSORS JOURNAL, 2022, 22 (18) :17421-17430
[5]  
Gomez-Garcia R., 2017, P 2017 1 IEEE MTT S, P1
[6]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[7]   Thumbs up, thumbs down: non-verbal human-robot interaction through real-time EMG classification via inductive and supervised transductive transfer learning [J].
Kobylarz, Jhonatan ;
Bird, Jordan J. ;
Faria, Diego R. ;
Ribeiro, Eduardo Parente ;
Ekart, Aniko .
JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2020, 11 (12) :6021-6031
[8]   Improving Classification Accuracy of Hand Gesture Recognition Based on 60 GHz FMCW Radar with Deep Learning Domain Adaptation [J].
Lee, Hyo Ryun ;
Park, Jihun ;
Suh, Young-Joo .
ELECTRONICS, 2020, 9 (12) :1-24
[9]  
Malysa G, 2016, IEEE GLOB CONF SIG, P1017, DOI 10.1109/GlobalSIP.2016.7905995
[10]   Dop-NET: a micro-Doppler radar data challenge [J].
Ritchie, M. ;
Capraru, R. ;
Fioranelli, F. .
ELECTRONICS LETTERS, 2020, 56 (11) :568-569