A template matching approach of one-shot-learning gesture recognition

被引:27
作者
Mahbub, Upal [1 ]
Imtiaz, Hafiz [1 ]
Roy, Tonmoy [1 ]
Rahman, Md. Shafiur [1 ]
Ahad, Md. Atiqur Rahman [2 ]
机构
[1] Bangladesh Univ Engn & Technol, Dept Elect & Elect Engn, Dhaka 1000, Bangladesh
[2] Univ Dhaka, Dept Appl Phys Elect & Commun Engn, Dhaka, Bangladesh
关键词
Gesture recognition; Depth image; Motion history image; 2D Fourier transform; MOTION; SEGMENTATION;
D O I
10.1016/j.patrec.2012.09.014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a novel approach for gesture recognition from motion depth images based on template matching. Gestures can be represented with image templates, which in turn can be used to compare and match gestures. The proposed method uses a single example of an action as a query to find similar matches and thus termed one-shot-learning gesture recognition. It does not require prior knowledge about actions, foreground/background segmentation, or any motion estimation or tracking. The proposed method makes a novel approach to separate different gestures from a single video. Moreover, this method is based on the computation of space-time descriptors from the query video which measures the likeness of a gesture in a lexicon. These descriptor extraction methods include the standard deviation of the depth images of a gesture as well as the motion history image. Furthermore, two dimensional discrete Fourier transform is employed to reduce the effect of camera shift. The comparison is done based on correlation coefficient of the image templates and an intelligent classifier is proposed to ensure better recognition accuracy. Extensive experimentation is done on a very complicated and diversified dataset to establish the effectiveness of employing the proposed methods. (C) 2012 Elsevier B.V. All rights reserved.
引用
收藏
页码:1780 / 1788
页数:9
相关论文
共 33 条
  • [1] Ahad MAR, 2008, 2008 INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS, VOLS 1-4, P1607
  • [2] Motion history image: its variants and applications
    Ahad, Md. Atiqur Rahman
    Tan, J. K.
    Kim, H.
    Ishikawa, S.
    [J]. MACHINE VISION AND APPLICATIONS, 2012, 23 (02) : 255 - 281
  • [3] [Anonymous], 2011, COMPUTER VISION ACTI
  • [4] [Anonymous], 1992, DIGITAL IMAGE PROCES
  • [5] [Anonymous], IEEE T CIRCUITS SYST
  • [6] [Anonymous], STANFORDEDU
  • [7] [Anonymous], 2011, CHALEARN GEST DAT
  • [8] [Anonymous], P BMCV
  • [9] Bobick A., 1996, Proceedings of the 13th International Conference on Pattern Recognition, P307, DOI 10.1109/ICPR.1996.546039
  • [10] The recognition of human movement using temporal templates
    Bobick, AF
    Davis, JW
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (03) : 257 - 267