Glove-Based Hand Gesture Recognition for Diver Communication

被引:27
作者
Antillon, Derek W. Orbaugh [1 ]
Walker, Christopher R. [1 ]
Rosset, Samuel [1 ]
Anderson, Iain A. [1 ]
机构
[1] Univ Auckland, Auckland Bioengn Inst, Biomimet Lab, Auckland 1010, New Zealand
关键词
Sensors; Gesture recognition; Intelligent sensors; Machine learning algorithms; Training; Capacitive sensors; Capacitance; Dielectric elastomer (DE) sensors; gesture recognition glove; glove-based gesture recognition; hand gesture recognition; machine learning algorithms; smart dive glove; smart glove; underwater gesture recognition;
D O I
10.1109/TNNLS.2022.3161682
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We have developed a smart dive glove that recognizes 13 static hand gestures used in diving communication. The smart glove employs five dielectric elastomer sensors to capture finger motion and implements a machine learning classifier in the onboard electronics to recognize gestures. Five basic classification algorithms are trained and assessed: the decision tree, support vector machine (SVM), logistic regression, Gaussian naive Bayes, and multilayer perceptron. These basic classifiers were selected as they perform well in multiclass classification problems, can be trained using supervised learning, and are model-based algorithms that can be implemented on a microprocessor. The training dataset was collected from 24 participants providing for a range of different hand sizes. After training, the algorithms were evaluated in a dry environment using data collected from ten new participants to test how well they cope with new information. Furthermore, an underwater experiment was conducted to assess any impact of the underwater environment on each algorithm's classification. The results show all classifiers performed well in a dry environment. The accuracies and F1-scores range between 0.95 and 0.98, where the logistic regressor and SVM have the highest scores for both the accuracy and F1-score (0.98). The underwater results showed that all algorithms work underwater; however, the performance drops when divers must focus on buoyancy control, breathing, and diver trim.
引用
收藏
页码:9874 / 9886
页数:13
相关论文
共 37 条
  • [1] Abhishek KS, 2016, IEEE C ELEC DEVICES, P334, DOI 10.1109/EDSSC.2016.7785276
  • [2] Aggarwal L., 2013, International Journal of Computer Applications, V79, P39, DOI DOI 10.5120/13805-1906
  • [3] Asokan A, 2016, 2016 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION FOR HUMANITARIAN APPLICATIONS (RAHA), P178
  • [4] Berezhnoy V., 2018, P 15 INT C INF CONTR, VVolume 2, P448
  • [5] Bhaskaran K A., 2016, 2016 International Conference on Robotics and Automation for Humanitarian Applications (RAHA), P1, DOI DOI 10.1109/RAHA.2016.7931887
  • [6] Bhuyan MK, 2020, 2020 INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS SIGNAL PROCESSING AND NETWORKING (WISPNET), P25, DOI [10.1109/wispnet48689.2020.9198521, 10.1109/WiSPNET48689.2020.9198521]
  • [7] Chan TK, 2018, 2018 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS, ROBOTICS AND AUTOMATION (ICMRA), P95, DOI 10.1109/ICMRA.2018.8490559
  • [8] A survey of glove-based systems and their applications
    Dipietro, Laura
    Sabatini, Angelo M.
    Dario, Paolo
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2008, 38 (04): : 461 - 482
  • [9] Analog Sensing and Computing Systems with Low Power Consumption for Gesture Recognition
    Fan, Tianyi
    Liu, Zheyu
    Luo, Zewei
    Li, Junda
    Tian, Xiyue
    Chen, Yeshen
    Feng, Yuan
    Wang, Chaolun
    Bi, Hengchang
    Li, Xinming
    Qiao, Fei
    Wu, Xing
    [J]. ADVANCED INTELLIGENT SYSTEMS, 2021, 3 (01)
  • [10] 3D human gesture capturing and recognition by the IMMU-based data glove
    Fang, Bin
    Sun, Fuchun
    Liu, Huaping
    Liu, Chunfang
    [J]. NEUROCOMPUTING, 2018, 277 : 198 - 207