Gesture generation by the robotic hand for aiding speech and hard of hearing persons based on indian sign language

被引:0
作者
Verma, Yash [1 ]
Anand, R. S. [1 ]
机构
[1] Indian Inst Technol Roorkee, Dept Elect Engn, Roorkee, India
关键词
Hearing impairments; Hearing aids; Sign language; Robotic hand;
D O I
10.1016/j.heliyon.2024.e29678
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Speech and hearing impairments are among the most common problems in Indian societies. It can affect anyone, whether children, adults, or more. Many different treatments can help to overcome hearing problems. Different types of hearing aids and cochlear implants help amplify sounds for better hearing. The type of language known as sign language is very scientific and has its grammar and syntax. Still, due to a need for more awareness among hard -of -hearing persons, they need to be made familiar with the institutions where they can learn and equip themselves for communication. This paper describes an approach to aid speech and hard -of -hearing persons so that they are free to communicate with persons who do not have speech and hearing disabilities based on the Indian Sign Language System. To find an appropriate solution, there is a need to develop a system that can act as an interpreter for speech and hard -of -hearing persons. The interpreter system is designed with the help of the Robotic hand model and is programmed using Raspberry Pi 4. Based on the experimental results, it can be observed that the robotic hands generated different signs of the alphabet corresponding to the speech commands uttered by an individual. Several experimental trials were conducted by ten persons who do not have any hearing disabilities. The results of the five experimental trials are shown in this paper. The estimation of performance parameters and statistical analysis are also carried out to analyze better and interpret the experimental results. Based on the experimental results, the proposed robotic hand interpreter system model accurately generates gestures corresponding to different alphabets used in the Indian Sign Language system, yielding an overall accuracy of 94 percent.
引用
收藏
页数:19
相关论文
共 13 条
  • [11] Sign Language Generation System Based on Indian Sign Language Grammar
    Sugandhi
    Kumar, Parteek
    Kaur, Sanmeet
    [J]. ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2020, 19 (04)
  • [12] Continuous Indian Sign Language Gesture Recognition and Sentence Formation
    Tripathi, Kumud
    Baranwal, Neha
    Nandi, G. C.
    [J]. ELEVENTH INTERNATIONAL CONFERENCE ON COMMUNICATION NETWORKS, ICCN 2015/INDIA ELEVENTH INTERNATIONAL CONFERENCE ON DATA MINING AND WAREHOUSING, ICDMW 2015/NDIA ELEVENTH INTERNATIONAL CONFERENCE ON IMAGE AND SIGNAL PROCESSING, ICISP 2015, 2015, 54 : 523 - 531
  • [13] A neural network model. for coordination of hand gesture during reach to grasp
    Vilaplana, JM
    Coronado, JL
    [J]. NEURAL NETWORKS, 2006, 19 (01) : 12 - 30