Gesture recognition based on millimeter-wave radar with pure self-attention mechanism

被引:0
作者
Zhang C. [1 ,2 ]
Wang G. [1 ,2 ]
Chen Q. [1 ,2 ]
Deng Z. [1 ,2 ]
机构
[1] School of Information and Communication Engineering, Harbin Engineering University, Harbin
[2] Key Laboratory of Advanced Marine Communication and Information Technology, Ministry of Industry and Information Technology, Harbin
来源
Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics | 2024年 / 46卷 / 03期
关键词
gesture recognition; millimeter-wave radar; noise suppression; self-attention mechanism;
D O I
10.12305/j.issn.1001-506X.2024.03.11
中图分类号
学科分类号
摘要
In the context of building intelligent control and the internet of everything, remote control of devices through hand gestures for human-computer interaction has gradually become a research hotspot. For this, a gesture recognition method based on pure self-attention mechanism model with millimeter-wave radar as sensor is proposed. Firstly, the time sequence echo data of 13 kinds of gestures from the front-view direction is collected. Then, three-dimension fast Fourier transform (3D-FFT), moving target indication (MTI) and constant false alarm rate (CFAR) detector operations are carried out on the data and fixed type Feature extraction. These features arc introduced into radar feature transformer (RFT) based network. Finally, based on the measured data, the steps of data feature extraction, network training, gesture recognition and so on are completed. The experimental results show that the accuracy rate of the proposed method in the test dataset is 95. 38%. Moreover, it has the characteristics of short metwork training time, low model complexity and good generalization, which provides a new research idea for the existing research. © 2024 Chinese Institute of Electronics. All rights reserved.
引用
收藏
页码:859 / 867
页数:8
相关论文
共 32 条
[1]  
WANG J, ZHENG T, LEI P, Et al., Hand gesture recognition method by radar based on convolutional neural network, Journal of Beijing University of Aeronautics and Astronautics, 44, 6, pp. 1117-1123, (2018)
[2]  
WANG Y, WANG S S, TIAN Z S, Et al., Two-stream fusion neural network approach for hand gesture recognition based on FMCW radar, Acta Electronica Sinica, 47, 7, pp. 1408-1415, (2019)
[3]  
XIA C Y, ZHOU C L, JIE J Y, Et al., Micromotion gesture recognition based on multi-channel frequency modulated continuous wave millimeter wave radar, Journal of Electronics & Information Technology, 42, 1, pp. 164-172, (2020)
[4]  
JIN B, PENG Y, KUANG X F, Et al., Dynamic gesture recognition method based on millimeter-wave radar by one-dimensional series neural network, Journal of Electronics & Information Technology, 43, 9, pp. 2743-2750, (2021)
[5]  
FENG X, LIU T, CUI W Q, Et al., Hand-writing number recognition based on millimeter-wave radar with dual-view feature fusion network, Journal of Electronics & Information Technology, 45, 6, pp. 2134-2143, (2023)
[6]  
TOHIDI E, RADMARD M, MAJD M N, Et al., Compressive sensing MTI processing in distributed MIMO radars, IET Signal Processing, 12, 3, pp. 327-334, (2018)
[7]  
GARCIA F D A, RODRIGUEZ A C F, F-RAIDENRAICH G, Et al., CA-CFAR detection performance in homogeneous Weibull clutter, IEEE Geoscience and Remote Sensing Letters, 16, 6, pp. 887-891, (2019)
[8]  
QIU X P, SUN T X, XU Y G, Et al., Pretrained models for natural language proces-sing: a survey, Science China Technological Sciences, 63, pp. 1872-1897, (2020)
[9]  
ALVESPINTO A, DEMUS C, SPRANGERM, Et al., Iterative named entity recognition with conditional random fields, Applied Sciences, 12, 1, (2022)
[10]  
SAWAI R, PAIK I, KUWANA A., Sentence augmentation for language translation using GPT-2, Electronics, 10, 24, (2021)