EarGest: Hand Gesture Recognition with Earables

被引:3
作者
Alkiek, Khaled [1 ]
Harras, Khaled A. [2 ]
Youssef, Moustafa [1 ,3 ]
机构
[1] Alexandria Univ, Alexandria, Egypt
[2] Carnegie Mellon Univ, Pittsburgh, PA USA
[3] AUC, New Cairo, Egypt
来源
2022 19TH ANNUAL IEEE INTERNATIONAL CONFERENCE ON SENSING, COMMUNICATION, AND NETWORKING (SECON) | 2022年
关键词
Earables; gesture recognition; HCI; sensing;
D O I
10.1109/SECON55815.2022.9918622
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Earables have been increasingly gaining attention from consumers and manufacturers alike due to their small footprint, ease of use, and the added accessibility they bring. However, the limited interface of these devices, usually being a single button or force-sensor, inhibits their potential. Earables can provide a much richer experience by extending the ways in which users can interact with them. In this paper, we present EarGest, a novel earable-based hand gesture recognition system that does not require calibration or training, and works with commercially available BLE-enabled earphones and devices. Our proposed system is unique in its ability to leverage Bluetooth to detect hand motion near the ear to recognize gestures. By harnessing information from BLE connections between the wireless earphones and a host device, we accurately detect and classify different hand gestures performed by users, while also determining discrete levels of hand speed. EarGest operates without interfering with the regular functionality of the earphones and introduces minimal energy overhead on the host device. We implement a prototype of the system using eSense, a multi-sensory earable platform, and evaluate it in different scenarios and settings. Results show that our system can detect and classify seven near-ear hand gestures with an accuracy up to 98.5%, as well as identify hand motion speed with 96% accuracy.
引用
收藏
页码:91 / 99
页数:9
相关论文
共 50 条
[41]   A Proposal for MMG-based Hand Gesture Recognition [J].
Yamakawa, Shumpei ;
Nojima, Takuya .
ADJUNCT PROCEEDINGS OF THE 25TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, 2012, :89-90
[42]   Multiple-Classifiers Based Hand Gesture Recognition [J].
Li, Simin ;
Ni, Zihan ;
Sang, Nong .
PATTERN RECOGNITION (CCPR 2016), PT I, 2016, 662 :155-163
[43]   TraHGR: Transformer for Hand Gesture Recognition via Electromyography [J].
Zabihi, Soheil ;
Rahimian, Elahe ;
Asif, Amir ;
Mohammadi, Arash .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 :4211-4224
[44]   Accuracy Enhancement of Hand Gesture Recognition Using CNN [J].
Park, Gyutae ;
Chandrasegar, Vasantha Kumar ;
Koh, Jinhwan .
IEEE ACCESS, 2023, 11 :26496-26501
[45]   A novel set of features for continuous hand gesture recognition [J].
M. K. Bhuyan ;
D. Ajay Kumar ;
Karl F. MacDorman ;
Yuji Iwahori .
Journal on Multimodal User Interfaces, 2014, 8 :333-343
[46]   Human hand descriptions and gesture recognition for object manipulation [J].
Guzman Cobos, Salvador ;
Ferre, Manuel ;
Angel Sanchez-Uran, M. ;
Ortego, Javier ;
Aracil, Rafael .
COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING, 2010, 13 (03) :305-317
[47]   New Method for Optimization of Static Hand Gesture Recognition [J].
Badi, Haitham ;
Hamza, Alaa ;
Hasan, Sabah .
PROCEEDINGS OF THE 2017 INTELLIGENT SYSTEMS CONFERENCE (INTELLISYS), 2017, :542-544
[48]   Viewpoint-independent hand gesture recognition with Kinect [J].
Jiang, Feng ;
Wu, Shen ;
Yang, Gao ;
Zhao, Debin ;
Kung, S. Y. .
SIGNAL IMAGE AND VIDEO PROCESSING, 2014, 8 :S163-S172
[49]   A review of hand gesture and sign language recognition techniques [J].
Ming Jin Cheok ;
Zaid Omar ;
Mohamed Hisham Jaward .
International Journal of Machine Learning and Cybernetics, 2019, 10 :131-153
[50]   HAND GESTURE RECOGNITION WITH LEAP MOTION AND KINECT DEVICES [J].
Marin, Giulio ;
Dominio, Fabio ;
Zanuttigh, Pietro .
2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, :1565-1569