Analysis of 3D Hand Trajectory Gestures Using Stroke-Based Composite Hidden Markov Models

被引:0
|
作者
In-Cheol Kim
Sung-Il Chien
机构
[1] Kyungpook National University,School of Electronic and Electrical Engineering
来源
Applied Intelligence | 2001年 / 15卷
关键词
3D hand trajectory; gesture recognition; Polhemus sensor; stroke-based composition; hidden Markov model; coarticulation effect;
D O I
暂无
中图分类号
学科分类号
摘要
We present a glove-based hand gesture recognition system using hidden Markov models (HMMs) for recognizing the unconstrained 3D trajectory gestures of operators in a remote work environment. A Polhemus sensor attached to a PinchGlove is employed to obtain a sequence of 3D positions of a hand trajectory. The direct use of 3D data provides more naturalness in generating gestures, thereby avoiding some of the constraints usually imposed to prevent performance degradation when trajectory data are projected into a specific 2D plane. We use two kinds of HMMs according to the basic units to be modeled: gesture-based HMM and stroke-based HMM. The decomposition of gestures into more primitive strokes is quite attractive, since reversely concatenating stroke-based HMMs makes it possible to construct a new set of gesture-based HMMs. Any deterioration in performance and reliability arising from decomposition can be remedied by a fine-tuned relearning process for such composite HMMs. We also propose an efficient method of estimating a variable threshold of reliability for an HMM, which is found to be useful in rejecting unreliable patterns. In recognition experiments on 16 types of gestures defined for remote work, the fine-tuned composite HMM achieves the best performance of 96.88% recognition rate and also the highest reliability.
引用
收藏
页码:131 / 143
页数:12
相关论文
共 50 条
  • [1] Analysis of 3D hand trajectory gestures using stroke-based composite hidden Markov models
    Kim, IC
    Chien, SI
    APPLIED INTELLIGENCE, 2001, 15 (02) : 131 - 143
  • [2] Hand Gesture Spotting Based on 3D Dynamic Features Using Hidden Markov Models
    Elmezain, Mahmoud
    Al-Hamadi, Ayoub
    Michaelis, Bernd
    SIGNAL PROCESSING, IMAGE PROCESSING, AND PATTERN RECOGNITION, 2009, 61 : 9 - 16
  • [3] Spotting dynamic hand gestures in video image sequences using Hidden Markov Models
    Morguet, P
    Lang, M
    1998 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING - PROCEEDINGS, VOL 3, 1998, : 193 - 197
  • [4] A Discrete Hidden Markov Models Recognition Module for Temporal Series: Application to Real-Time 3D Hand Gestures.
    Dennemont, Yannick
    Bouyer, Guillaume
    Otmane, Samir
    Mallem, Malik
    2012 3RD INTERNATIONAL CONFERENCE ON IMAGE PROCESSING THEORY, TOOLS AND APPLICATIONS, 2012, : 299 - 304
  • [5] Gesture recognition for alphabets from hand motion trajectory using hidden Markov models
    Elmezain, Mahmoud
    Al-Hamadi, Ayoub
    Krell, Gerald
    El-Etriby, Sherif
    Michaelis, Bernd
    2007 IEEE INTERNATIONAL SYMPOSIUM ON SIGNAL PROCESSING AND INFORMATION TECHNOLOGY, VOLS 1-3, 2007, : 1170 - 1175
  • [6] 3D Hand Motion Tracking Using Improved Hidden Markov Model of Behavior
    Gai, Wei
    Feng, Zhiquan
    Yang, Bo
    Lin, Yan
    Song, Xianhui
    JOURNAL OF COMPUTERS, 2012, 7 (03) : 730 - 735
  • [7] Hidden Markov models-based 3D MRI brain segmentation
    Ibrahim, M.
    John, N.
    Kabuka, M.
    Younis, A.
    IMAGE AND VISION COMPUTING, 2006, 24 (10) : 1065 - 1079
  • [8] TRAJECTORY ANALYSIS OF SPEECH USING CONTINUOUS STATE HIDDEN MARKOV MODELS
    Weber, P.
    Houghton, S. M.
    Champion, C. J.
    Russell, M. J.
    Jancovic, P.
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [9] Human behavior recognition based on 3D features and hidden markov models
    Yuexin Wu
    Zhe Jia
    Yue Ming
    Juanjuan Sun
    Liujuan Cao
    Signal, Image and Video Processing, 2016, 10 : 495 - 502
  • [10] Human behavior recognition based on 3D features and hidden markov models
    Wu, Yuexin
    Jia, Zhe
    Ming, Yue
    Sun, Juanjuan
    Cao, Liujuan
    SIGNAL IMAGE AND VIDEO PROCESSING, 2016, 10 (03) : 495 - 502