Hand Gesture Recognition Using Automatic Feature Extraction and Deep Learning Algorithms with Memory

被引:7
作者
Nogales, Ruben E. [1 ]
Benalcazar, Marco E. E. [1 ]
机构
[1] Escuela Politec Nacl, Artificial Intelligence & Comp Vis Res Lab, Quito 170517, Ecuador
关键词
hand gesture recognition; feature selection; leap motion controller; feature extraction; recurrent neural network;
D O I
10.3390/bdcc7020102
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Gesture recognition is widely used to express emotions or to communicate with other people or machines. Hand gesture recognition is a problem of great interest to researchers because it is a high-dimensional pattern recognition problem. The high dimensionality of the problem is directly related to the performance of machine learning models. The dimensionality problem can be addressed through feature selection and feature extraction. In this sense, the evaluation of a model with manual feature extraction and automatic feature extraction was proposed. The manual feature extraction was performed using the statistical functions of central tendency, while the automatic extraction was performed by means of a CNN and BiLSTM. These features were also evaluated in classifiers such as Softmax, ANN, and SVM. The best-performing model was the combination of BiLSTM and ANN (BiLSTM-ANN), with an accuracy of 99.9912%.
引用
收藏
页数:14
相关论文
共 25 条
  • [1] Aggarwal K., 2022, Virtual and Augmented Reality for Automobile Industry: Innovation Vision and Applications, P145
  • [2] Effects of annotation quality on model performance
    Alhazmi, Khaled
    Alsumari, Walaa
    Seppo, Indrek
    Podkuiko, Lara
    Simon, Martin
    [J]. 3RD INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE IN INFORMATION AND COMMUNICATION (IEEE ICAIIC 2021), 2021, : 63 - 67
  • [3] A novel hybrid bidirectional unidirectional LSTM network for dynamic hand gesture recognition with Leap Motion
    Ameur, Safa
    Ben Khalifa, Anouar
    Bouhlel, Med Salim
    [J]. ENTERTAINMENT COMPUTING, 2020, 35 (35)
  • [4] Chronological pattern indexing: An efficient feature extraction method for hand gesture recognition with Leap Motion
    Ameur, Safa
    Ben Khalifa, Anouar
    Bouhlel, Med Salim
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2020, 70
  • [5] Benalcazar Marco E., 2017, 2017 IEEE 2 ECUADOR
  • [6] An image-to-class dynamic time warping approach for both 3D static and trajectory hand gesture recognition
    Cheng, Hong
    Dai, Zhongjun
    Liu, Zicheng
    Zhao, Yang
    [J]. PATTERN RECOGNITION, 2016, 55 : 137 - 147
  • [7] Clark Andrew., 2016, P ANN C S AFR I COMP, P1, DOI DOI 10.1145/2987491.2987511
  • [8] GOUHARA K, 1991, IEEE IJCNN, P746, DOI 10.1109/IJCNN.1991.170489
  • [9] Spatio-Temporal Approach using CNN-RNN in Hand Gesture Recognition
    Gunawan, Mochammad Rifky
    Djamal, Esmeralda Contessa
    [J]. 2021 4TH INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATICS ENGINEERING (IC2IE 2021), 2021, : 385 - 389
  • [10] Skeleton Based Dynamic Hand Gesture Recognition using LSTM and CNN
    Ikram, Aaahm
    Liu, Yue
    [J]. PROCEEDINGS OF 2020 2ND INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND MACHINE VISION AND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION AND MACHINE LEARNING, IPMV 2020, 2020, : 63 - 68