PAWdio: Hand Input for Mobile VR using Acoustic Sensing

被引:6
作者
Al Zayer, Majed [1 ]
Tregillus, Sam [1 ]
Folmer, Eelke [1 ]
机构
[1] Univ Nevada, Human Lab, Comp Sci, Reno, NV 89557 USA
来源
CHI PLAY 2016: PROCEEDINGS OF THE 2016 ANNUAL SYMPOSIUM ON COMPUTER-HUMAN INTERACTION IN PLAY | 2016年
关键词
Acoustic sensing; virtual reality; games; immersion; hand tracking; head-mounted display; switch input; natural input;
D O I
10.1145/2967934.2968079
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Hand input offers a natural, efficient and immersive form of input for virtual reality (VR), but it has been difficult to implement on mobile VR platforms. Accurate hand-tracking requires a depth sensor and performing computer vision on a smartphone is computationally intensive, which may degrade the frame rate of a VR simulation and drain battery life. PAWdio is a novel 1 degree of freedom (DOF) hand input technique that uses acoustic sensing to track the relative position of an earbud from a headset that the user holds in their hand. PAWdio requires no instrumentation and its low computational overhead assures a high frame rate. A user study with 18 subjects evaluates PAWdio with button input that is commonly available on VR adapters. Results with a 3D target selection task found a similar accuracy and usability, a significantly slower performance, but higher immersion for PAWdio. We discuss limitations and game applications of PAWdio.
引用
收藏
页码:154 / 158
页数:5
相关论文
共 23 条
  • [1] Barbagallo Ralph., How to support gear and google cardboard in one unity3d project
  • [2] Bowman D. A., 2004, 3D user interfaces: Theory and practice
  • [3] Clemons J, 2011, I S WORKL CHAR PROC, P91, DOI 10.1109/IISWC.2011.6114206
  • [4] Gowases T., 2008, P 16 INT C COMP ED I, P773
  • [5] Gupta S., 2012, P SIGCHI C HUM FACT, P1911, DOI DOI 10.1145/2207676.2208331
  • [6] Harrison C, 2010, CHI2010: PROCEEDINGS OF THE 28TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, VOLS 1-4, P453
  • [7] ONE-HANDED GESTURE RECOGNITION USING ULTRASONIC DOPPLER SONAR
    Kalgaonkar, Kaustubh
    Raj, Bhiksha
    [J]. 2009 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS 1- 8, PROCEEDINGS, 2009, : 1889 - +
  • [8] A human motor behavior model for distal pointing tasks
    Kopper, Regis
    Bowman, Doug A.
    Silva, Mara G.
    McMahan, Ryan P.
    [J]. INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 2010, 68 (10) : 603 - 615
  • [9] Laput G, 2015, CHI 2015: PROCEEDINGS OF THE 33RD ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, P2161
  • [10] SweepSense: Ad Hoc Configuration Sensing Using Reflected Swept-Frequency Ultrasonics
    Laput, Gierad
    Chen, Xiang 'Anthony'
    Harrison, Chris
    [J]. PROCEEDINGS OF THE 21ST INTERNATIONAL CONFERENCE ON INTELLIGENT USER INTERFACES (IUI'16), 2016, : 332 - 335