Nearest neighbour classification of Indian sign language gestures using kinect camera

被引：1
作者：
ZAFAR AHMED ANSARI
GAURAV HARIT
机构：
[1] Indian Institute of Technology Jodhpur,Department of Computer Science and Engineering
来源：
Sadhana | 2016年 / 41卷
关键词：
Indian sign language recognition; multi-class classification; gesture recognition.;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
People with speech disabilities communicate in sign language and therefore have trouble in mingling with the able-bodied. There is a need for an interpretation system which could act as a bridge between them and those who do not know their sign language. A functional unobtrusive Indian sign language recognition system was implemented and tested on real world data. A vocabulary of 140 symbols was collected using 18 subjects, totalling 5041 images. The vocabulary consisted mostly of two-handed signs which were drawn from a wide repertoire of words of technical and daily-use origins. The system was implemented using Microsoft Kinect which enables surrounding light conditions and object colour to have negligible effect on the efficiency of the system. The system proposes a method for a novel, low-cost and easy-to-use application, for Indian Sign Language recognition, using the Microsoft Kinect camera. In the fingerspelling category of our dataset, we achieved above 90% recognition rates for 13 signs and 100% recognition for 3 signs with overall 16 distinct alphabets (A, B, D, E, F, G, H, K, P, R, T, U, W, X, Y, Z) recognised with an average accuracy rate of 90.68%.
引用
收藏
页码：161 / 182
页数：21
相关论文
共 31 条
  • [1] Mitra S(2007)Gesture recognition: A survey IEEE Trans. Syst. Man Cybern. Part C: Appl. Rev. 37 311-324
  • [2] Acharya T(1998)Real-time american sign language recognition using desk and wearable computer based video. IEEE Trans. Pattern Anal. Mach. Intell. 20 1371-1375
  • [3] Starner T(2013)Real-time human pose recognition in parts from single depth images Commun. ACM 56 116-124
  • [4] Weaver J(2000)Normalized cuts and image segmentation IEEE Trans. Pattern Anal. Mach. Intell. 22 888-905
  • [5] Pentland A(2004)Distinctive image features from scale-invariant keypoints Int. J. Comp. Vis. 60 91-110
  • [6] Shotton J(2012)Scale invariant feature transform Scholarpedia 7 10491-270
  • [7] Sharp T(1994)Scale-space theory: A basic tool for analyzing structures at different scales J. Appl. Stat. 21 225-116
  • [8] Kipman A(1998)Feature detection with automatic scale selection Int. J. Comp. Vis. 30 79-2:35
  • [9] Fitzgibbon A(2007)Adaptive newton-based multivariate smoothed functional algorithms for simulation optimization ACM Trans. Model. Comput. Simul. 18 2:1-252
  • [10] Finocchio M(1999)Linear scale-space has first been proposed in japan J. Math. Imaging Vis. 10 237-25
1234