Fast-gesture recognition and classification using Kinect: an application for a virtual reality drumkit

被引:0
|
作者
Alejandro Rosa-Pujazón
Isabel Barbancho
Lorenzo J. Tardón
Ana M. Barbancho
机构
[1] Universidad de Málaga,E.T.S.I. Telecomunicación, Dpto. Ingeniería de Comunicaciones
[2] ATIC Research Group,undefined
[3] Andalucía Tech,undefined
来源
Multimedia Tools and Applications | 2016年 / 75卷
关键词
Drumkit simulator; Gesture recognition; Human-computer interaction; Machine learning; Classification techniques;
D O I
暂无
中图分类号
学科分类号
摘要
In this paper, we present a system for the detection of fast gestural motion by using a linear predictor of hand movements. We also use the proposed detection scheme for the implementation of a virtual drumkit simulator. A database of drum-hitting motions is gathered and two different sets of features are proposed to discriminate different drum-hitting gestures. The two feature sets are related to observations of different nature: the trajectory of the hand and the pose of the arm. These two sets are used to train classifier models using a variety of machine learning techniques in order to analyse which features and machine learning techniques are more suitable for our classification task. Finally, the system has been validated by means of the Kinect application implemented and the participation of 12 different subjects for the experimental performance evaluation. Results showed a successful discrimination rate higher than 95 % for six different gestures per hand and good user experience.
引用
收藏
页码:8137 / 8164
页数:27
相关论文
共 50 条
  • [1] Fast-gesture recognition and classification using Kinect: an application for a virtual reality drumkit
    Rosa-Pujazon, Alejandro
    Barbancho, Isabel
    Tardon, Lorenzo J.
    Barbancho, Ana M.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2016, 75 (14) : 8137 - 8164
  • [2] Gesture Recognition Using Kinect in a Virtual Classroom Environment
    Hariharan, Balaji
    Padmini, S.
    Gopalakrishnan, Uma
    2014 FOURTH INTERNATIONAL CONFERENCE ON DIGITAL INFORMATION AND COMMUNICATION TECHNOLOGY AND IT'S APPLICATIONS (DICTAP), 2014, : 118 - 124
  • [3] Gesture recognition in virtual reality
    Kavakli, Manolya
    INTERNATIONAL JOURNAL OF ARTS AND TECHNOLOGY, 2008, 1 (02) : 215 - 229
  • [4] A Review on Gesture Recognition Using Kinect
    Jais, Hairina Mohd
    Mahayuddin, Zainal Rasyid
    Arshad, Haslina
    5TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING AND INFORMATICS 2015, 2015, : 594 - 599
  • [5] Application Interface for Gesture Recognition with Kinect Sensor
    Maraj, Dardan
    Maraj, Arianit
    Hajzeraj, Adhurim
    2016 IEEE INTERNATIONAL CONFERENCE ON KNOWLEDGE ENGINEERING AND APPLICATIONS (ICKEA 2016), 2016, : 98 - 102
  • [6] Virtual Reality using Gesture Recognition for Deck Operation Training
    Strazdins, Girts
    Pedersen, Birger S.
    Zhang, Houxiang
    Major, Pierre
    OCEANS 2017 - ABERDEEN, 2017,
  • [7] Dynamic Hand Gesture Recognition Using Kinect
    Kadethankar, Atharva Ajit
    Joshi, Apurv Dilip
    2017 INNOVATIONS IN POWER AND ADVANCED COMPUTING TECHNOLOGIES (I-PACT), 2017,
  • [8] Gesture Recognition Toolkit Using a Kinect Sensor
    Giuroiu, Marius-Cristian
    Marita, Tiberiu
    2015 IEEE 11TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTER COMMUNICATION AND PROCESSING (ICCP), 2015, : 317 - 324
  • [9] Dynamic Fingure Gesture Recognition using KINECT
    Varshini, Lavanya M. R.
    Vidhyapathi, C. M.
    PROCEEDINGS OF 2016 INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION CONTROL AND COMPUTING TECHNOLOGIES (ICACCCT), 2016, : 212 - 216
  • [10] A Kinect-based Virtual Rehabilitation System through Gesture Recognition
    Zhao, Liping
    Lu, Xiong
    Tao, Xianglin
    Chen, Xiaoli
    2016 INTERNATIONAL CONFERENCE ON VIRTUAL REALITY AND VISUALIZATION (ICVRV 2016), 2016, : 380 - 384