Deep Learning Approach for Hand Gesture Recognition: Applications in Deaf Communication and Healthcare

被引:8
作者
Aurangzeb, Khursheed [1 ]
Javeed, Khalid [2 ]
Alhussein, Musaed [1 ]
Rida, Imad [3 ]
Haider, Syed Irtaza [1 ]
Parashar, Anubha [4 ]
机构
[1] King Saud Univ, Coll Comp & Informat Sci, Dept Comp Engn, POB 51178, Riyadh 11543, Saudi Arabia
[2] Univ Sharjah, Coll Comp & Informat, Dept Comp Engn, Sharjah 27272, U Arab Emirates
[3] Univ Technol Compiegne, Lab Biomech & Bioengn, F-60200 Compiegne, France
[4] Manipal Univ Jaipur, Dept Comp Sci & Engn, Jaipur 303007, India
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2024年 / 78卷 / 01期
关键词
Computer vision; deep learning; gait recognition; sign language recognition; machine learning; NETWORK;
D O I
10.32604/cmc.2023.042886
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Hand gestures have been used as a significant mode of communication since the advent of human civilization. By facilitating human -computer interaction (HCI), hand gesture recognition (HGRoc) technology is crucial for seamless and error -free HCI. HGRoc technology is pivotal in healthcare and communication for the deaf community. Despite significant advancements in computer vision -based gesture recognition for language understanding, two considerable challenges persist in this field: (a) limited and common gestures are considered, (b) processing multiple channels of information across a network takes huge computational time during discriminative feature extraction. Therefore, a novel hand vision -based convolutional neural network (CNN) model named (HVCNNM) offers several benefits, notably enhanced accuracy, robustness to variations, real-time performance, reduced channels, and scalability. Additionally, these models can be optimized for real-time performance, learn from large amounts of data, and are scalable to handle complex recognition tasks for efficient human -computer interaction. The proposed model was evaluated on two challenging datasets, namely the Massey University Dataset (MUD) and the American Sign Language (ASL) Alphabet Dataset (ASLAD). On the MUD and ASLAD datasets, HVCNNM achieved a score of 99.23% and 99.00%, respectively. These results demonstrate the effectiveness of CNN as a promising HGRoc approach. The findings suggest that the proposed model have potential roles in applications such as sign language recognition, human -computer interaction, and robotics.
引用
收藏
页码:127 / 144
页数:18
相关论文
共 47 条
[1]   Gesture recognition from RGB images using convolutional neural network-attention based system [J].
Barbhuiya, Abul Abbas ;
Karsh, Ram Kumar ;
Jain, Rahul .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2022, 34 (24)
[2]   CNN based feature extraction and classification for sign language [J].
Barbhuiya, Abul Abbas ;
Karsh, Ram Kumar ;
Jain, Rahul .
MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (02) :3051-3069
[3]   An Experimental Analysis of Various Machine Learning Algorithms for Hand Gesture Recognition [J].
Bhushan, Shashi ;
Alshehri, Mohammed ;
Keshta, Ismail ;
Chakraverti, Ashish Kumar ;
Rajpurohit, Jitendra ;
Abugabah, Ahed .
ELECTRONICS, 2022, 11 (06)
[4]   A convolutional neural network with feature fusion for real-time hand posture recognition [J].
Chevtchenko, Sergio F. ;
Vale, Rafaella F. ;
Macario, Valmir ;
Cordeiro, Filipe R. .
APPLIED SOFT COMPUTING, 2018, 73 :748-766
[5]   HGR-Net: a fusion network for hand gesture segmentation and recognition [J].
Dadashzadeh, Amirhossein ;
Targhi, Alireza Tavakoli ;
Tahmasbi, Maryam ;
Mirmehdi, Majid .
IET COMPUTER VISION, 2019, 13 (08) :700-707
[6]   Static hand gesture recognition in sign language based on convolutional neural network with feature extraction method using ORB descriptor and Gabor filter [J].
Damaneh, Mahin Moghbeli ;
Mohanna, Farahnaz ;
Jafari, Pouria .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 211
[7]   A lightweight architecture for hand gesture recognition [J].
Dang, Tuan Linh ;
Pham, Trung Hieu ;
Dang, Quang Minh ;
Monet, Nicolas .
MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (18) :28569-28587
[8]   Adversarial Unsupervised Domain Adaptation for Hand Gesture Recognition Using Thermal Images [J].
Dayal, Aveen ;
Aishwarya, M. ;
Abhilash, S. ;
Mohan, C. Krishna ;
Kumar, Abhinav ;
Cenkeramaddi, Linga Reddy .
IEEE SENSORS JOURNAL, 2023, 23 (04) :3493-3504
[9]   Hand gesture recognition based on a Harris Hawks optimized Convolution Neural Network [J].
Gadekallu, Thippa Reddy ;
Srivastava, Gautam ;
Liyanage, Madhusanka ;
Iyapparaja, M. ;
Chowdhary, Chiranji Lal ;
Koppu, Srinivas ;
Maddikunta, Praveen Kumar Reddy .
COMPUTERS & ELECTRICAL ENGINEERING, 2022, 100
[10]  
Gupta B, 2016, INT CONF COMP COMMUN