BeamBand: Hand Gesture Sensing with Ultrasonic Beamforming

被引:40
作者
Iravantchi, Yasha [1 ]
Goel, Mayank [1 ]
Harrison, Chris [1 ]
机构
[1] Carnegie Mellon Univ, Human Comp Interact Inst, 5000 Forbes Ave, Pittsburgh, PA 15213 USA
来源
CHI 2019: PROCEEDINGS OF THE 2019 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS | 2019年
关键词
Hand Input; Hand Gesture; Acoustic Reflectrometry; Acoustic Beamforming; Acoustic; Interaction Techniques; Wearables;
D O I
10.1145/3290605.3300245
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
BeamBand is a wrist-worn system that uses ultrasonic beamforming for hand gesture sensing. Using an array of small transducers, arranged on the wrist, we can ensemble acoustic wavefronts to project acoustic energy at specified angles and focal lengths. This allows us to interrogate the surface geometry of the hand with inaudible sound in a raster-scan-like manner, from multiple viewpoints. We use the resulting. characteristic reflections to recognize hand pose at 8 FPS. In our user study, we found that BeamBand supports a six-class hand gesture set at 94.6% accuracy. Even across sessions, when the sensor is removed and reworn later, accuracy remains high: 89.4%. We describe our software and hardware. and future avenues for integration into devices such as smartwatches and VR controllers.
引用
收藏
页数:10
相关论文
共 48 条
[1]  
[Anonymous], 2002, CHI 02 EXTENDED ABST
[2]  
[Anonymous], BERL BEAMF C
[3]  
Araki Shoko, 2007, IEEE INT C AC SPEECH, V1, P1, DOI [10.1109/ICASSP.2007.366611, DOI 10.1109/ICASSP.2007.366611]
[4]   Adding Directional Context to Gestures Using Doppler Effect [J].
Bannis, Adeola ;
Pan, Shijia ;
Zhang, Pei .
PROCEEDINGS OF THE 2014 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING (UBICOMP'14 ADJUNCT), 2014, :5-8
[5]   Acoustic physics - Suspended by sound [J].
Brandt, EH .
NATURE, 2001, 413 (6855) :474-475
[6]  
Carter T., 2013, P 26 ANN ACM S US IN, P505, DOI [10.1145/2501988.2502018, DOI 10.1145/2501988.2502018]
[7]  
Colaco A., 2013, Proc. of the 26th Annual ACM Symposium on User Interface Software and Technology, P227, DOI DOI 10.1145/2501988.2502042
[8]  
Dementyev A., 2014, P 27 ANN ACM S USER, P161, DOI [DOI 10.1145/2642918.2647396, 10.1145/2642918.2647396]
[9]  
Deyle T, 2007, ELEVENTH IEEE INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, PROCEEDINGS, P3
[10]  
Fukui R, 2011, UBICOMP'11: PROCEEDINGS OF THE 2011 ACM INTERNATIONAL CONFERENCE ON UBIQUITOUS COMPUTING, P311