Performance analysis of static hand gesture recognition approaches using artificial neural network, support vector machine and two stream based transfer learning approach

被引:5
作者
Patil A.R. [1 ]
Subbaraman S. [2 ]
机构
[1] DKTE’s TEI, Maharashtra, Ichalkaranji
[2] Walchand College of Engineering, Maharashtra, Sangli
关键词
Artificial Neural Network; Aspect ratio; Circular ratio; Deep learning; Eccentricity; Fourier descriptors; Inception V3; MobileNet; Support vector machine; Transfer learning;
D O I
10.1007/s41870-021-00831-7
中图分类号
学科分类号
摘要
Gesture recognition is the statistical representation used to identify specific gestures of motion involving the hands, head, face, and/or body. The paper addresses Hand Gesture Recognition (HGR) using novel machine learning and deep learning approaches. Machine learning algorithms viz. Artificial Neural Network (ANN) and Support Vector Machine (SVM) was implemented using spatial features comprising of geometrical features and Fourier descriptors. The experimental results revealed that ANN is better compared with SVM results. A novel decision fusion based two stream transfer learning approach was implemented using deep learning techniques in this paper. The two pretrained models MobileNet (0.5 and 1.0) and Inception V3 were used. The Region Of Interest (ROI) provided by YOLO was used to make a decision of which model is used for testing. The novel approach provided real time 99.6% recognition accuracy. © 2021, Bharati Vidyapeeth's Institute of Computer Applications and Management.
引用
收藏
页码:3781 / 3792
页数:11
相关论文
共 37 条
  • [1] Vladimir I., Et al., Visual interpretation of hand gestures for human-computer interaction: a review, IEEE Trans Pattern Anal Mach Intel, 19, 7, pp. 677-695, (1997)
  • [2] Mitra S., Acharya T., Gesture recognition: a survey, IEEE Trans Syst Man Cybern Part C (Applications and Reviews), 37, 3, pp. 311-324, (2007)
  • [3] Lu Z., Et al., A hand gesture recognition framework and wearable gesture-based interaction prototype for mobile devices, Human-Mach Syst IEEE Trans, (2014)
  • [4] Zhu C., Sheng W., Wearable sensor-based hand gesture and daily activity recognition for robot-assisted living, IEEE Trans Syst Man Cybern-Part A: Syst Hum, 41, 3, pp. 569-573, (2011)
  • [5] Cheng H., Yang L., Liu Z., Survey on 3D hand gesture recognition, IEEE Trans Circuits Syst Video Technol, 26, 9, pp. 1659-1673, (2016)
  • [6] Park S., Yu S., Kim J., Et al., 3D hand tracking using Kalman filter in depth space, EURASIP J Adv Signal Process, (2012)
  • [7] Patil A.R., Subbaraman S., Illumination invariant hand gesture classification against complex background using combinational features, Int J Comput Sci Inf Secur, 16, 3, pp. 63-70, (2018)
  • [8] Kakumanu P., Makrogiannis S., Bourbakis N., A survey of skin-color modeling and detection methods, Pattern Recogn, 40, 3, pp. 1106-1122, (2007)
  • [9] Bishesh K., Et al., Efficient skin detection under severe illumination changes and shadows, 4Th International Conference on Intelligent Robotics and Applications, ICIRA, pp. 1-8, (2011)
  • [10] Berens J., Finlayson G., Log-opponent chromaticity coding of color space, Proceedings International Conference on Pattern Recognition, 1, pp. 206-211, (2000)