A Piezoresistive Array Armband With Reduced Number of Sensors for Hand Gesture Recognition

被引:50
作者
Esposito, Daniele [1 ,2 ]
Andreozzi, Emilio [1 ,2 ]
Gargiulo, Gaetano D. [3 ]
Fratini, Antonio [4 ]
D'Addio, Giovanni [2 ]
Naik, Ganesh R. [5 ]
Bifulco, Paolo [1 ,2 ]
机构
[1] Univ Naples Federico II, Polytech & Basic Sci Sch, Dept Elect Engn & Informat Technol, Naples, Italy
[2] IRCCS Inst Clin Sci Maugeri, Dept Neurorehabil, Pavia, Italy
[3] Western Sydney Univ, Sch Comp Engn & Math, Penrith, NSW, Australia
[4] Aston Univ, Sch Life & Hlth Sci, Birmingham, England
[5] Western Sydney Univ, MARCS Inst Brain Behav & Dev, Penrith, NSW, Australia
关键词
muscle sensors array; piezoresistive sensor; human-machine interface; hand gesture recognition; support vector machine; exergaming; FORCE MYOGRAPHY; LOW-COST;
D O I
10.3389/fnbot.2019.00114
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human machine interfaces (HMIs) are employed in a broad range of applications, spanning from assistive devices for disability to remote manipulation and gaming controllers. In this study, a new piezoresistive sensors array armband is proposed for hand gesture recognition. The armband encloses only three sensors targeting specific forearm muscles, with the aim to discriminate eight hand movements. Each sensor is made by a force-sensitive resistor (FSR) with a dedicated mechanical coupler and is designed to sense muscle swelling during contraction. The armband is designed to be easily wearable and adjustable for any user and was tested on 10 volunteers. Hand gestures are classified by means of different machine learning algorithms, and classification performances are assessed applying both, the 10-fold and leave-one-out cross-validations. A linear support vector machine provided 96% mean accuracy across all participants. Ultimately, this classifier was implemented on an Arduino platform and allowed successful control for videogames in real-time. The low power consumption together with the high level of accuracy suggests the potential of this device for exergames commonly employed for neuromotor rehabilitation. The reduced number of sensors makes this HMI also suitable for hand-prosthesis control.
引用
收藏
页数:12
相关论文
共 50 条
[21]   HAND GESTURE RECOGNITION: AN OVERVIEW [J].
Yang, Shuai ;
Premaratne, Prashan ;
Vial, Peter .
2013 5TH IEEE INTERNATIONAL CONFERENCE ON BROADBAND NETWORK & MULTIMEDIA TECHNOLOGY (IC-BNMT), 2013, :63-69
[22]   Recognition of Static Hand Gesture [J].
Sadeddine, Khadidja ;
Djeradi, Rachida ;
Chelali, Fatma Zohra ;
Djeradi, Amar .
PROCEEDINGS OF 2018 6TH INTERNATIONAL CONFERENCE ON MULTIMEDIA COMPUTING AND SYSTEMS (ICMCS), 2018, :368-373
[23]   A Method for Hand Gesture Recognition [J].
Shukla, Jaya ;
Dwivedi, Ashutosh .
2014 FOURTH INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS AND NETWORK TECHNOLOGIES (CSNT), 2014, :919-923
[24]   A Survey on Hand Gesture Recognition [J].
Chen, Lingchen ;
Wang, Feng ;
Deng, Hui ;
Ji, Kaifan .
2013 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCES AND APPLICATIONS (CSA), 2013, :313-316
[25]   Sensors for Gesture Recognition Systems [J].
Berman, Sigal ;
Stern, Helman .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2012, 42 (03) :277-290
[26]   Hand Gesture Recognition Using Deep Feature Fusion Network Based on Wearable Sensors [J].
Yuan, Guan ;
Liu, Xiao ;
Yan, Qiuyan ;
Qiao, Shaojie ;
Wang, Zhixiao ;
Yuan, Li .
IEEE SENSORS JOURNAL, 2021, 21 (01) :539-547
[27]   WAVEGLOVE: TRANSFORMER-BASED HAND GESTURE RECOGNITION USING MULTIPLE INERTIAL SENSORS [J].
Kralik, Matej ;
Suppa, Marek .
29TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2021), 2021, :1576-1580
[28]   Deep Learning for Hand Gesture Recognition in Virtual Museum Using Wearable Vision Sensors [J].
Zerrouki, Nabil ;
Harrou, Fouzi ;
Houacine, Amrane ;
Bouarroudj, Riadh ;
Cherifi, Mohammed Yazid ;
Zouina, Ait-Djafer Amina ;
Sun, Ying .
IEEE SENSORS JOURNAL, 2024, 24 (06) :8857-8869
[29]   Hand gesture recognition based on convolution neural network [J].
Gongfa Li ;
Heng Tang ;
Ying Sun ;
Jianyi Kong ;
Guozhang Jiang ;
Du Jiang ;
Bo Tao ;
Shuang Xu ;
Honghai Liu .
Cluster Computing, 2019, 22 :2719-2729
[30]   Hand gesture recognition based on convolution neural network [J].
Li, Gongfa ;
Tang, Heng ;
Sun, Ying ;
Kong, Jianyi ;
Jiang, Guozhang ;
Jiang, Du ;
Tao, Bo ;
Xu, Shuang ;
Liu, Honghai .
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2019, 22 (02) :S2719-S2729