Hand Gesture Recognition Based on Various Deep Learning YOLO Models

被引:0
|
作者
Mesbahi, Soukaina Chraa [1 ]
Mahraz, Mohamed Adnane [1 ]
Riffi, Jamal [1 ]
Tairi, Hamid [1 ]
机构
[1] Sidi Mohamed Ben Abdellah Univ, Fac Sci Dhar El Mahraz, Dept Comp Sci, Lab Comp Sci Signals Automat & Cognitivism LISAC, Fes, Morocco
关键词
Neural network; deep learning; YOLO; object detection; hand gesture; SIGN-LANGUAGE; LOCALIZATION; NETWORK;
D O I
10.14569/IJACSA.2023.0140435
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Some varieties of sign languages are used by deaf or hard-of-hearing people worldwide to interact with others more effectively, consequently sign language's automatic translation is expressive and important. Significant improvements in computer vision have been made recently, notably in tasks based on object detection using deep learning. By locating things in visual photos or videos, the genuine cutting-edge one-step object detection approach greatly provides exceptional detection accuracy. With the help of messaging or video calling, this study suggests a technique to get beyond these obstacles and enhance communication for such persons, regardless of their disability. To recognize motions and classes, we provide an enhanced model based on Yolo (You Look Only Once) V3, V4, V4-tiny, and V5. The dataset is clustered using the suggested algorithm, requiring only manual annotation of a reduced number of classes and analysis for patterns that aid in target prediction. The suggested method outperforms the current object detection approaches based on the YOLO model, according to experimental results.
引用
收藏
页码:307 / 319
页数:13
相关论文
共 50 条
  • [11] Deep Learning Based Hand Gesture Recognition and UAV Flight Controls
    Hu, Bin
    Wang, Jiacun
    INTERNATIONAL JOURNAL OF AUTOMATION AND COMPUTING, 2020, 17 (01) : 17 - 29
  • [12] Deep learning in vision-based static hand gesture recognition
    Oyebade K. Oyedotun
    Adnan Khashman
    Neural Computing and Applications, 2017, 28 : 3941 - 3951
  • [13] Hand Gesture Recognition against Complex Background Based on Deep Learning
    Peng Y.
    Zhao X.
    Tao H.
    Liu X.
    Li T.
    Jiqiren/Robot, 2019, 41 (04): : 534 - 542
  • [14] Hand Gesture Recognition Based on Electromyography Signals and Deep Learning Techniques
    Abdelaziz, Mai H.
    Mohamed, Wael A.
    Selmy, Ayman S.
    JOURNAL OF ADVANCES IN INFORMATION TECHNOLOGY, 2024, 15 (02) : 255 - 263
  • [15] Deep Learning Based Hand Gesture Recognition and UAV Flight Controls
    Bin Hu
    Jiacun Wang
    International Journal of Automation and Computing, 2020, 17 : 17 - 29
  • [16] Deep Learning Based Hand Gesture Recognition and UAV Flight Controls
    Hu, Bin
    Wang, Jiacun
    2018 24TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATION AND COMPUTING (ICAC' 18), 2018, : 20 - 25
  • [17] Deep Learning-Based Hand Gesture Recognition for Collaborative Robots
    Nuzzi, Cristina
    Pasinetti, Simone
    Lancini, Matteo
    Docchio, Franco
    Sansoni, Giovanna
    IEEE INSTRUMENTATION & MEASUREMENT MAGAZINE, 2019, 22 (02) : 44 - 51
  • [18] Hand Pose Estimation Based on Deep Learning Depth Map for Hand Gesture Recognition
    Otberdout, Naima
    Ballihi, Lahoucine
    Aboutajdine, Driss
    2017 INTELLIGENT SYSTEMS AND COMPUTER VISION (ISCV), 2017,
  • [19] Integrated Deep Learning Structures for Hand Gesture Recognition
    Korkmaz, Senol
    13TH INTERNATIONAL CONFERENCE ON THEORY AND APPLICATION OF FUZZY SYSTEMS AND SOFT COMPUTING - ICAFS-2018, 2019, 896 : 129 - 136
  • [20] Deep Learning for Hand Gesture Recognition on Skeletal Data
    Devineau, Guillaume
    Xi, Wang
    Moutarde, Fabien
    Yang, Jie
    PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, : 106 - 113