MEMS Devices-Based Hand Gesture Recognition via Wearable Computing

被引:18
作者
Wang, Huihui [1 ]
Ru, Bo [2 ]
Miao, Xin [2 ]
Gao, Qin [3 ]
Habib, Masood [2 ]
Liu, Long [1 ,2 ]
Qiu, Sen [2 ]
机构
[1] Dalian Neusoft Univ Informat, Sch Intelligence & Elect Engn, Dalian 116023, Peoples R China
[2] Dalian Univ Technol, Key Lab Intelligent Control & Optimizat Ind Equipm, Minist Educ, Dalian 116024, Peoples R China
[3] Taizhou Univ, Coll Aeronaut Engn, Taizhou 318000, Peoples R China
基金
中国国家自然科学基金;
关键词
inertial sensor; gesture recognition; support vector machine; hidden markov model; deep learning; INFORMATION; MACHINE;
D O I
10.3390/mi14050947
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Gesture recognition has found widespread applications in various fields, such as virtual reality, medical diagnosis, and robot interaction. The existing mainstream gesture-recognition methods are primarily divided into two categories: inertial-sensor-based and camera-vision-based methods. However, optical detection still has limitations such as reflection and occlusion. In this paper, we investigate static and dynamic gesture-recognition methods based on miniature inertial sensors. Hand-gesture data are obtained through a data glove and preprocessed using Butterworth low-pass filtering and normalization algorithms. Magnetometer correction is performed using ellipsoidal fitting methods. An auxiliary segmentation algorithm is employed to segment the gesture data, and a gesture dataset is constructed. For static gesture recognition, we focus on four machine learning algorithms, namely support vector machine (SVM), backpropagation neural network (BP), decision tree (DT), and random forest (RF). We evaluate the model prediction performance through cross-validation comparison. For dynamic gesture recognition, we investigate the recognition of 10 dynamic gestures using Hidden Markov Models (HMM) and Attention-Biased Mechanisms for Bidirectional Long- and Short-Term Memory Neural Network Models (Attention-BiLSTM). We analyze the differences in accuracy for complex dynamic gesture recognition with different feature datasets and compare them with the prediction results of the traditional long- and short-term memory neural network model (LSTM). Experimental results demonstrate that the random forest algorithm achieves the highest recognition accuracy and shortest recognition time for static gestures. Moreover, the addition of the attention mechanism significantly improves the recognition accuracy of the LSTM model for dynamic gestures, with a prediction accuracy of 98.3%, based on the original six-axis dataset.
引用
收藏
页数:22
相关论文
共 34 条
  • [1] Deep-Learning-Based Character Recognition from Handwriting Motion Data Captured Using IMU and Force Sensors
    Alemayoh, Tsige Tadesse
    Shintani, Masaaki
    Lee, Jae Hoon
    Okamoto, Shingo
    [J]. SENSORS, 2022, 22 (20)
  • [2] Recognition of Uni-Stroke Characters with Hand Movements in 3D Space Using Convolutional Neural Networks
    Chang, Won-Du
    Matsuoka, Akitaka
    Kim, Kyeong-Taek
    Shin, Jungpil
    [J]. SENSORS, 2022, 22 (16)
  • [3] Chen Z., 2020, WIREL INTERNET TECHN, V17, P3
  • [4] Choe Namchol, 2018, Journal of Dalian University of Technology, V58, P105, DOI 10.7511/dllgxb201801016
  • [5] Evaluation of Full-Body Gestures Performed by Individuals with Down Syndrome: Proposal for Designing User Interfaces for All Based on Kinect Sensor
    Del Rio Guerra, Marta Sylvia
    Martin-Gutierrez, Jorge
    [J]. SENSORS, 2020, 20 (14) : 1 - 22
  • [6] Inertial Motion Sensing Glove for Sign Language Gesture Acquisition and Recognition
    Galka, Jakub
    Masior, Mariusz
    Zaborski, Mateusz
    Barczewska, Katarzyna
    [J]. IEEE SENSORS JOURNAL, 2016, 16 (16) : 6310 - 6316
  • [7] Geiger W, 2008, IEEE POSITION LOCAT, P82
  • [8] Hochreiter S, 1997, NEURAL COMPUT, V9, P1735, DOI [10.1162/neco.1997.9.1.1, 10.1007/978-3-642-24797-2]
  • [9] Extreme Learning Machine for Regression and Multiclass Classification
    Huang, Guang-Bin
    Zhou, Hongming
    Ding, Xiaojian
    Zhang, Rui
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2012, 42 (02): : 513 - 529
  • [10] Huang J., 2015, Comput. Syst. Appl., V24, P259