Head-mounted gesture controlled interface for human-computer interaction

被引:63
作者
Memo, Alvise [1 ]
Zanuttigh, Pietro [1 ]
机构
[1] Univ Padua, Dept Informat Engn, Padua, Italy
关键词
Head mounted display; Gesture recognition; Human-computer interface; Augmented reality; Depth data; RECOGNITION; FUSION;
D O I
10.1007/s11042-016-4223-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a novel human-computer interaction system exploiting gesture recognition. It is based on the combined usage of an head-mounted display and a multi-modal sensor setup including also a depth camera. The depth information is used both to seamlessly include augmented reality elements into the real world and as input for a novel gesture-based interface. Reliable gesture recognition is obtained through a real-time algorithm exploiting novel feature descriptors arranged in a multi-dimensional structure fed to an SVM classifier. The system has been tested with various augmented reality applications including an innovative human-computer interaction scheme where virtual windows can be arranged into the real world observed by the user.
引用
收藏
页码:27 / 53
页数:27
相关论文
共 50 条
  • [41] Multimodal human-computer interaction: A survey
    Jaimes, Alejandro
    Sebe, Nicu
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2007, 108 (1-2) : 116 - 134
  • [42] Human-Computer Interaction in Face Matching
    Fysh, Matthew C.
    Bindemann, Markus
    COGNITIVE SCIENCE, 2018, 42 (05) : 1714 - 1732
  • [43] How much is enough? The human factors of field-of-view in head-mounted displays
    Melzer, Jim
    DEGRADED ENVIRONMENTS: SENSING, PROCESSING, AND DISPLAY 2017, 2017, 10197
  • [44] A dynamic hand gesture recognition dataset for human-computer interfaces
    Fronteddu, Graziano
    Porcu, Simone
    Floris, Alessandro
    Atzori, Luigi
    COMPUTER NETWORKS, 2022, 205
  • [45] Bringing the Economic Model to the Human-Computer Interface
    Kwiat, Kevin A.
    2006 3RD IEEE CONSUMER COMMUNICATIONS AND NETWORKING CONFERENCE, VOLS 1-3, 2006, : 711 - 714
  • [46] The role of cognitive theory in human-computer interface
    Chalmers, PA
    COMPUTERS IN HUMAN BEHAVIOR, 2003, 19 (05) : 593 - 607
  • [47] Views on designing human-computer interface for EIS
    Hu, WX
    Zhong, WJ
    Xu, NR
    DESIGN OF COMPUTING SYSTEMS: COGNITIVE CONSIDERATIONS, 1997, 21 : 809 - 812
  • [48] Measuring Throughput of the HeadJoystick Human-Computer Interface
    Music, Josip
    Cecic, Mojmil
    Bonkovic, Mirjana
    PROCEEDINGS OF THE 9TH WSEAS INTERNATIONAL CONFERENCE ON SIMULATION, MODELLING AND OPTIMIZATION, 2009, : 112 - +
  • [49] Magnetic Hand Tracking for Human-Computer Interface
    Ma, Yinghong
    Mao, Zhi-Hong
    Jia, Wenyan
    Li, Chengliu
    Yang, Jiawei
    Sun, Mingui
    IEEE TRANSACTIONS ON MAGNETICS, 2011, 47 (05) : 970 - 973