AUTOMATED GESTURE RECOGNITION USING ARTIFICIAL RABBITS OPTIMIZATION WITH DEEP LEARNING FOR ASSISTING VISUALLY CHALLENGED PEOPLE

被引:1
作者
Marzouk, Radwa [1 ,2 ]
Aldehim, Ghadah [1 ]
Al-Hagery, Mohammed abdullah [3 ]
Hilal, Anwer mustafa [4 ]
Alneil, Amani a. [4 ]
机构
[1] Princess Nourah Bint Abdulrahman Univ, Coll Comp & Informat Sci, Dept Informat Syst, POB 84428, Riyadh 11671, Saudi Arabia
[2] Cairo Univ, Fac Sci, Dept Math, Giza 12613, Egypt
[3] Qassim Univ, Coll Comp, Dept Comp Sci, Buraydah, Saudi Arabia
[4] Prince Sattam Bin Abdulaziz Univ, Dept Comp & Self Dev, Preparatory Year Deanship, AlKharj, Saudi Arabia
关键词
Gesture Recognition; Deep Learning; Visually Challenged People; Artificial Rabbits Optimization; Human-Computer Interaction;
D O I
10.1142/S0218348X24501317
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Gesture recognition technology has become a transformative solution to enhance accessibility for people with vision impairments. This innovation enables the interpretation of body and hand movements, transforming them into meaningful information or commands by applying advanced computer vision sensors and algorithms. This technology serves as an intuitive interface for the visually impaired, enabling them to access information seamlessly, navigate digital devices, and interact with their surroundings, fostering more independence and inclusivity in day-to-day activities. Gesture recognition solutions using deep learning (DL) leverage neural networks (NN) to understand intricate patterns in human gestures. DL algorithms can identify and classify different hand and body movements accurately by training on extensive datasets. Therefore, this study develops an automated gesture recognition using artificial rabbits optimization with deep learning (AGR-ARODL) technique for assisting visually challenged persons. The AGR-ARODL technique mainly intends to assist visually challenged people in the recognition of various kinds of hand gestures. In accomplishing this, the AGR-ARODL technique primarily pre-processes the input images using a median filtering (MF) approach. Next, the AGR-ARODL technique involves the SE-ResNet-50 model to derive feature patterns and its hyperparameter selection process is carried out by the use of the artificial rabbit optimization (ARO) algorithm. The AGR-ARODL technique applies a deep belief network (DBN) model for the detection of various hand gestures. The simulation results of the AGR-ARODL method are tested under the benchmark gesture recognition dataset. Widespread experimental analysis underscored the betterment of the AGR-ARODL technique compared to recent DL models.
引用
收藏
页数:12
相关论文
共 25 条
[1]   Unified learning approach for egocentric hand gesture recognition and fingertip detection [J].
Alam, Mohammad Mahmudul ;
Islam, Mohammad Tariqul ;
Rahman, S. M. Mahbubur .
PATTERN RECOGNITION, 2022, 121
[2]  
Alsolai H., 2023, HELIYON
[3]   DeepArSLR: A Novel Signer-Independent Deep Learning Framework for Isolated Arabic Sign Language Gestures Recognition [J].
Aly, Saleh ;
Aly, Walaa .
IEEE ACCESS, 2020, 8 :83199-83212
[4]   Multi-retinal disease classification by reduced deep learning features [J].
Arunkumar, R. ;
Karthigaikumar, P. .
NEURAL COMPUTING & APPLICATIONS, 2017, 28 (02) :329-334
[5]   British Sign Language Recognition via Late Fusion of Computer Vision and Leap Motion with Transfer Learning to American Sign Language [J].
Bird, Jordan J. ;
Ekart, Aniko ;
Faria, Diego R. .
SENSORS, 2020, 20 (18) :1-19
[6]   Sign and Human Action Detection Using Deep Learning [J].
Dhulipala, Shivanarayna ;
Adedoyin, Festus Fatai ;
Bruno, Alessandro .
JOURNAL OF IMAGING, 2022, 8 (07)
[7]   Dynamic Hand Gesture Recognition Based on Signals From Specialized Data Glove and Deep Learning Algorithms [J].
Dong, Yongfeng ;
Liu, Jielong ;
Yan, Wenjie .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
[8]   RETRACTED: Machine learning based sign language recognition: a review and its research frontier (Retracted Article) [J].
Elakkiya, R. .
JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021, 12 (07) :7205-7224
[9]   Vision-based Hand Gesture Recognition for Indian Sign Language Using Convolution Neural Network [J].
Gangrade, Jayesh ;
Bharti, Jyoti .
IETE JOURNAL OF RESEARCH, 2023, 69 (02) :723-732
[10]  
Gao Q., 2019, P UK WORKSH COMP INT, V19, P107