Hand Gesture Recognition Based on Various Deep Learning YOLO Models

被引:0
作者
Mesbahi, Soukaina Chraa [1 ]
Mahraz, Mohamed Adnane [1 ]
Riffi, Jamal [1 ]
Tairi, Hamid [1 ]
机构
[1] Sidi Mohamed Ben Abdellah Univ, Fac Sci Dhar El Mahraz, Dept Comp Sci, Lab Comp Sci Signals Automat & Cognitivism LISAC, Fes, Morocco
关键词
Neural network; deep learning; YOLO; object detection; hand gesture; SIGN-LANGUAGE; LOCALIZATION; NETWORK;
D O I
10.14569/IJACSA.2023.0140435
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Some varieties of sign languages are used by deaf or hard-of-hearing people worldwide to interact with others more effectively, consequently sign language's automatic translation is expressive and important. Significant improvements in computer vision have been made recently, notably in tasks based on object detection using deep learning. By locating things in visual photos or videos, the genuine cutting-edge one-step object detection approach greatly provides exceptional detection accuracy. With the help of messaging or video calling, this study suggests a technique to get beyond these obstacles and enhance communication for such persons, regardless of their disability. To recognize motions and classes, we provide an enhanced model based on Yolo (You Look Only Once) V3, V4, V4-tiny, and V5. The dataset is clustered using the suggested algorithm, requiring only manual annotation of a reduced number of classes and analysis for patterns that aid in target prediction. The suggested method outperforms the current object detection approaches based on the YOLO model, according to experimental results.
引用
收藏
页码:307 / 319
页数:13
相关论文
共 52 条
[1]  
Alam M. M., 2021, UMBC STUDENT COLLECT
[2]  
Bang CY, 2016, IEEE IMAGE PROC, P4413, DOI 10.1109/ICIP.2016.7533194
[3]   Tiny Hand Gesture Recognition without Localization via a Deep Convolutional Network [J].
Bao, Peijun ;
Maqueda, Ana I. ;
del-Blanco, Carlos R. ;
Garcia, Narciso .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2017, 63 (03) :251-257
[4]  
Biasotti S., EXPLOITING SILHOUETT
[5]  
Bochkovskiy A., 2020, Darknet: Open Source Neural Networks in Python
[6]  
Bochkovskiy A, 2020, Arxiv, DOI [arXiv:2004.10934, DOI 10.48550/ARXIV.2004.10934]
[7]   SubUNets: End-to-end Hand Shape and Continuous Sign Language Recognition [J].
Camgoz, Necati Cihan ;
Hadfield, Simon ;
Koller, Oscar ;
Bowden, Richard .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :3075-3084
[8]   A convolutional neural network with feature fusion for real-time hand posture recognition [J].
Chevtchenko, Sergio F. ;
Vale, Rafaella F. ;
Macario, Valmir ;
Cordeiro, Filipe R. .
APPLIED SOFT COMPUTING, 2018, 73 :748-766
[9]   Joint Hand Detection and Rotation Estimation Using CNN [J].
Deng, Xiaoming ;
Zhang, Yinda ;
Yang, Shuo ;
Tan, Ping ;
Chang, Liang ;
Yuan, Ye ;
Wang, Hongan .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) :1888-1900
[10]   Sign Language Numeral Gestures Recognition Using Convolutional Neural Network [J].
Gruber, Ivan ;
Ryumin, Dmitry ;
Hruz, Marek ;
Karpov, Alexey .
INTERACTIVE COLLABORATIVE ROBOTICS, ICR 2018, 2018, 11097 :70-77