Deep-Learning Methods for Hand-Gesture Recognition Using Ultra-Wideband Radar

被引:44
|
作者
Skaria, Sruthy [1 ]
Al-Hourani, Akram [1 ]
Evans, Robin J. [2 ]
机构
[1] RMIT Univ, Sch Engn, Melbourne, Vic 3000, Australia
[2] Univ Melbourne, Dept Elect & Elect Engn, Melbourne, Vic 3010, Australia
关键词
Hand-gesture recognition; deep-learning; radar sensors; radar signal processing; UWB impulse radar; SYSTEM; SENSORS;
D O I
10.1109/ACCESS.2020.3037062
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Using deep-learning techniques for analyzing radar signatures has opened new possibilities in the field of smart-sensing, especially in the applications of hand-gesture recognition. In this paper, we present a framework, using deep-learning techniques, to classify hand-gesture signatures generated from an ultra-wideband (UWB) impulse radar. We extract the signals of 14 different hand-gestures and represent each signature as a 3-dimensional tensor consisting of range-Doppler frame sequence. These signatures are passed to a convolutional neural network (CNN) to extract the unique features of each gesture, and are then fed to a classifier. We compare 4 different classification architectures to predict the gesture class, namely; (i) fully connected neural network (FCNN), (ii) k-Nearest Neighbours (k-NN), (iii) support vector machine (SVM), (iv) long short term memory (LSTM) network. The shape of the range-Doppler-frame tensor and the parameters of the classifiers are optimized in order to maximize the classification accuracy. The classification results of the proposed architectures show a high level of accuracy above 96 % and a very low confusion probability even between similar gestures.
引用
收藏
页码:203580 / 203590
页数:11
相关论文
共 50 条
  • [1] Deep-Learning for Hand-Gesture Recognition with Simultaneous Thermal and Radar Sensors
    Skaria, Sruthy
    Huang, Da
    Al-Hourani, Akram
    Evans, Robin J.
    Lech, Margaret
    2020 IEEE SENSORS, 2020,
  • [2] Hand Gesture Recognition Using Ultra-Wideband Radar with Random Forest
    Li Yao
    Wang, Xin
    He Wentao
    Shi Baodai
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (22)
  • [3] Ultra-Wideband Radar-Based Activity Recognition Using Deep Learning
    Noori, Farzan M.
    Uddin, Md Zia
    Torresen, Jim
    IEEE ACCESS, 2021, 9 (09) : 138132 - 138143
  • [4] Hand-Gesture Recognition Using Two-Antenna Doppler Radar With Deep Convolutional Neural Networks
    Skaria, Sruthy
    Al-Hourani, Akram
    Lech, Margaret
    Evans, Robin J.
    IEEE SENSORS JOURNAL, 2019, 19 (08) : 3041 - 3048
  • [5] Radar-Thermal Sensor Fusion Methods for Deep Learning Hand Gesture Recognition
    Skaria, Sruthy
    Al-Hourani, Akram
    Huang, Da
    2021 IEEE SENSORS, 2021,
  • [6] Hand Gesture Recognition Using Deep Learning
    Hussain, Soeb
    Saxena, Rupal
    Han, Xie
    Khan, Jameel Ahmed
    Shin, Hyunchul
    PROCEEDINGS INTERNATIONAL SOC DESIGN CONFERENCE 2017 (ISOCC 2017), 2017, : 48 - 49
  • [7] Face Gesture Recognition Using Deep-Learning Models
    Espinel, Andrés
    Pérez, Noel
    Riofrío, Daniel
    Benítez, Diego
    Moyano, Ricardo Flores
    2021 IEEE Colombian Conference on Applications of Computational Intelligence, ColCACI 2021 - Proceedings, 2021,
  • [8] Face Gesture Recognition Using Deep-Learning Models
    Espinel, Andres
    Perez, Noel
    Riofrio, Daniel
    Benitez, Diego
    Flores Moyano, Ricardo
    2021 IEEE COLOMBIAN CONFERENCE ON APPLICATIONS OF COMPUTATIONAL INTELLIGENCE - COLCACI, 2021,
  • [9] Multidimensional Feature Representation and Learning for Robust Hand-Gesture Recognition on Commercial Millimeter-Wave Radar
    Xia, Zhaoyang
    Luomei, Yixiang
    Zhou, Chenglong
    Xu, Feng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (06): : 4749 - 4764
  • [10] Hand-gesture recognition using computer-vision techniques
    Rios-Soria, David J.
    Schaeffer, Satu E.
    Garza-Villarreal, Sara E.
    WSCG 2013, COMMUNICATION PAPERS PROCEEDINGS, 2013, : 1 - 8