Tanzanian sign language recognition system for an assistive communication glove sign tutor based on the inertial sensor fusion control algorithm

被引:1
作者
Isack Bulugu [1 ]
机构
[1] University of Dar es Salaam,Department of Electronics and Telecommunications Engineering
关键词
Sign language recognition; Data gloves; Hearing-impaired people; Sensor fusion control;
D O I
10.1186/s43067-025-00199-9
中图分类号
学科分类号
摘要
This paper presents a sign language recognition system for sign tutoring assistive hand data gloves for hearing-impaired people. In this study, specially designed 5-fingered data gloves are used for interaction and communication with hearing-impaired or hard-of-hearing people using signs. In this paper, a sign language recognition scheme based on an inertial sensor fusion control algorithm is proposed to achieve efficient and accurate real-time sign language recognition. The fusion control algorithm uses a feedback control idea to fuse two traditional attitude information calculation methods, reducing the impact of the environment on the sensor. The attitude information of the tested object in the instantaneous state can be accurately obtained. The algorithm uses the classification methods of support vector machine (SVM), K-nearest neighbor method (KNN) and feedforward neural network (FNN) classifier adaptive model to classify the data collected by the sign language data through data fusion, data preprocessing and feature extraction. The results show that the proposed sensor fusion control algorithm effectively obtains real-time poses. The recognition accuracy of the sign language recognition scheme for 26 kinds of Tanzanian sign languages is 96.5%. The proposed scheme will lay a solid foundation for sign language recognition systems and provide a reference for relevant research on sensor fusion control.
引用
收藏
相关论文
共 50 条
[41]   AI-Enabled Sign Language Recognition and Communication System For Speech/Hearing-Impaired Users [J].
Wen, Feng .
2024 IEEE INTERNATIONAL CONFERENCE ON SMART INTERNET OF THINGS, SMARTIOT 2024, 2024, :67-70
[42]   A Kinect-Based Sign Language Hand Gesture Recognition System for Hearing- and Speech-Impaired: A Pilot Study of Pakistani Sign Language [J].
Halim, Zahid ;
Abbas, Ghulam .
ASSISTIVE TECHNOLOGY, 2015, 27 (01) :34-43
[43]   Deep learning-based sign language recognition system using both manual and non-manual components fusion [J].
Jebali, Maher ;
Dakhli, Abdesselem ;
Bakari, Wided .
AIMS MATHEMATICS, 2024, 9 (01) :2105-2122
[44]   Fusion of Attention-Based Convolution Neural Network and HOG Features for Static Sign Language Recognition [J].
Kumari, Diksha ;
Anand, Radhey Shyam .
APPLIED SCIENCES-BASEL, 2023, 13 (21)
[45]   Novel Feature Extraction and Classification Technique for Sensor-Based Continuous Arabic Sign Language Recognition [J].
Tuffaha, Mohammed ;
Shanableh, Tamer ;
Assaleh, Khaled .
NEURAL INFORMATION PROCESSING, ICONIP 2015, PT IV, 2015, 9492 :290-299
[46]   Continuous word level sign language recognition using an expert system based on machine learning [J].
Sreemathy R. ;
Turuk M.P. ;
Chaudhary S. ;
Lavate K. ;
Ushire A. ;
Khurana S. .
International Journal of Cognitive Computing in Engineering, 2023, 4 :170-178
[47]   A Conditional Random Field based Indian Sign Language Recognition System under Complex Background [J].
Choudhury, Ananya ;
Talukdar, Anjan Kumar ;
Sarma, Kandarpa Kumar .
2014 FOURTH INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS AND NETWORK TECHNOLOGIES (CSNT), 2014, :900-904
[48]   Efficient Sign Language Recognition System and Dataset Creation Method Based on Deep Learning and Image Processing [J].
Cavalcante Carneiro, A. L. ;
Silva, L. Brito ;
Pinheiro Salvadeo, D. H. .
THIRTEENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2021), 2021, 11878
[49]   Gesture Recognition System For Isolated Word Sign Language Based On key-Point Trajectory Matrix [J].
Fakhfakh, Sana ;
Ben Jemaa, Yousra .
COMPUTACION Y SISTEMAS, 2018, 22 (04) :1415-1430
[50]   An isolated Vietnamese Sign Language Recognition method using a fusion of Heatmap and Depth information based on Convolutional Neural Networks [J].
Xuan-Phuoc Nguyen ;
Thi-Huong Nguyen ;
Duc-Tan Tran ;
Tien-Son Bui ;
Van-Toi Nguyen .
2024 ASIA PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE, APSIPA ASC, 2024,