Indian Sign Language Recognition Using Kinect Sensor

被引：8

作者：

Mehrotra, Kapil ^{[1
]}

Godbole, Atul ^{[1
]}

Belhe, Swapnil ^{[1
]}

机构：

[1] Ctr Dev Adv Comp, Pune, Maharashtra, India

来源：

IMAGE ANALYSIS AND RECOGNITION (ICIAR 2015) | 2015年 / 9164卷

关键词：

D O I：

10.1007/978-3-319-20801-5_59

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

There has been a lot of research on automatic recognition of Sign languages and is an effective means of transferring information for Deaf and Hard of Hearing (HoH) community. Here we propose a system for Indian Sign Language recognition, which uses Microsoft Kinect sensor and Machine learning for effectively recognizing some signs used in Indian Sign Language. Kinect generates the skeleton of a human body and detects 20 joints in it. We use 11 out of 20 joints and extract 34 novel features per frame, based on distances and angles involving upper body joints. These features are trained with a multi-class Support Vector Machine achieving an accuracy of 100% and 86.16% on train and test data respectively. Proposed system recognizes 37 signs in real time. The data is used in the proposed system is generated by the Deaf and Hard of Hearing (HoH) persons in our lab.

引用

页码：528 / 535

页数：8

共 50 条

[41] Indian Sign Language Recognition Using Optimized Neural Networks [J].

Hore, Sirshendu ;

Chatterjee, Sankhadeep ;

Santhi, V. ;

Dey, Nilanjan ;

Ashour, Amira S. ;

Balas, Valentina Emilia ;

Shi, Fuqian .

INFORMATION TECHNOLOGY AND INTELLIGENT TRANSPORTATION SYSTEMS, VOL 2, 2017, 455 :553-563

[42] Indian Sign Language Recognition Using ANN And SVM Classifiers [J].

Ekbote, Juhi ;

Joshi, Mahasweta .

2017 INTERNATIONAL CONFERENCE ON INNOVATIONS IN INFORMATION, EMBEDDED AND COMMUNICATION SYSTEMS (ICIIECS), 2017,

[43] Indian Sign Language Translator Using Gesture Recognition Algorithm [J].

Badhe, Purva C. ;

Kulkarni, Vaishali .

2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER GRAPHICS, VISION AND INFORMATION SECURITY (CGVIS), 2015, :195-200

[44] Research and Implementation of Sign Language Recognition Method Based on Kinect [J].

Chen, Yuqian ;

Zhang, Wenhui .

2016 2ND IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATIONS (ICCC), 2016, :1947-1951

[45] Some Approaches to Recognition of Sign Language Dynamic Expressions with Kinect [J].

Oszust, M. ;

Wysocki, M. .

Advances in Intelligent Systems and Computing, 2014, 300 :75-86

[46] LATENT SUPPORT VECTOR MACHINE FOR SIGN LANGUAGE RECOGNITION WITH KINECT [J].

Sun, Chao ;

Zhang, Tianzhu ;

Bao, Bing-Kun ;

Xu, Changsheng .

2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, :4190-4194

[47] A Kinect Based Sign Language Recognition System Using Spatio-temporal Features [J].

Memis, Abbas ;

Albayrak, Songul .

SIXTH INTERNATIONAL CONFERENCE ON MACHINE VISION (ICMV 2013), 2013, 9067

[48] Occlusion robust sign language recognition system for indian sign language using CNN and pose features [J].

Das S. ;

Biswas S.K. ;

Purkayastha B. .

Multimedia Tools and Applications, 2024, 83 (36) :84141-84160

[49] American Sign Language Recognition Using Leap Motion Sensor [J].

Chuan, Ching-Hua ;

Regina, Eric ;

Guardino, Caroline .

2014 13TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2014, :541-544

[50] Arabic Sign Language Recognition Using Leap Motion Sensor [J].

Elons, A. S. ;

Ahmed, Menna ;

Shedid, Hwaidaa ;

Tolba, M. F. .

2014 9TH INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING & SYSTEMS (ICCES), 2014, :368-373

← 1 2 3 4 5 →