Effect of variation in gesticulation pattern in dynamic hand gesture recognition system

被引:26
作者
Singha, Joyeeta [1 ]
Misra, Songhita [1 ]
Laskar, Rabul Hussain [1 ]
机构
[1] Natl Inst Technol, Dept ECE, Silchar, India
关键词
Human computer interaction; Hand gesture recognition; Feature extraction; Gesture pattern variation;
D O I
10.1016/j.neucom.2016.05.049
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a hand gesture recognition system which addresses the effect of variations in gesture pattern during gesticulation. Different gestures can be gesticulated in various patterns which increase the difficulties in recognizing the gestures. We have proposed two new features such as left sector trajectory features and right sector trajectory features which are able to recognize gestures even with the presence of variations in the gesticulation pattern. The effectiveness of the proposed system is illustrated by different experiments with our own gesture database. A comparative study has been made with the proposed features and three state-of-art features such as orientation; combination of location, orientation, velocity; and combination of ellipse and position features. The performance of the system was evaluated using this proposed set of features for different individual classifiers such as ANN, SVM, k-NN, Naive Bayes and ELM. Finally, the decisions of the individual classifiers were combined using major voting rule to result in classifier fusion model. Based on the experimental results it may be concluded that classifier fusion provides satisfactory results compared to other individual classifiers. An accuracy of 91.07% was achieved using the classifier fusion technique as compared to baseline CRF (79.45%) and HCRF (83.07%) models. (C) 2016 Elsevier B.V. All rights reserved.
引用
收藏
页码:269 / 280
页数:12
相关论文
共 36 条
[1]  
[Anonymous], MULTIMED SYST
[2]  
[Anonymous], TR561 ETH
[3]   Rule-based trajectory segmentation for modeling hand motion trajectory [J].
Beh, Jounghoon ;
Han, David ;
Ko, Hanseok .
PATTERN RECOGNITION, 2014, 47 (04) :1586-1601
[4]  
Bhuyan MK, 2006, LECT NOTES COMPUT SC, V4338, P564
[5]  
Bhuyan MK, 2006, CONF CYBERN INTELL S, P748
[6]   A novel set of features for continuous hand gesture recognition [J].
Bhuyan, M. K. ;
Kumar, D. Ajay ;
MacDorman, Karl F. ;
Iwahori, Yuji .
JOURNAL ON MULTIMODAL USER INTERFACES, 2014, 8 (04) :333-343
[7]  
Bhuyan MK., 2008, WORLD ACAD SCI ENG T, V21, P753
[8]   Skeleton-based action recognition with extreme learning machines [J].
Chen, Xi ;
Koskela, Markus .
NEUROCOMPUTING, 2015, 149 :387-396
[9]   Real-Time Hand Gesture Detection and Recognition Using Bag-of-Features and Support Vector Machine Techniques [J].
Dardas, Nasser H. ;
Georganas, Nicolas D. .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2011, 60 (11) :3592-3607
[10]  
Dasarathy B.V., 1990, NEAREST NEIGHBOR NN