Diverse hand gesture recognition dataset

被引:3
|
作者
Mohammadi, Zahra [1 ]
Akhavanpour, Alireza [2 ]
Rastgoo, Razieh [3 ]
Sabokrou, Mohammad [4 ]
机构
[1] Shahid Beheshti Univ, Comp Sci & Engn Dept, Tehran 1983969411, Iran
[2] Shenasa, Artificial Intelligence Grp, Tehran 1456755131, Iran
[3] Semnan Univ, Elect & Comp Engn Dept, Semnan 3513119111, Iran
[4] Inst Res Fundamental Sci IPM, Tehran 193955746, Iran
关键词
Hand Gesture Recognition (HGR); Deep learning; Dataset; Hand Pose Estimation (HPE); Computer vision; SIGN-LANGUAGE RECOGNITION;
D O I
10.1007/s11042-023-17268-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Hand Gesture Recognition(HGR) is a challenging computer vision task. Recently, by taking advantages of deep learning-based models, HGR methods have achieved outstanding results and outperformed state-of-the-art alternatives by a high margin. However, the performance of deep learning-based models is highly dependent on the data. A large amount of data is required to train deep learning-based models. While there are some widely-used datasets in HGR, these datasets lack diverse gestures in real-world situations. To this end, we propose a hand gesture dataset (Dataset will be publicly available after paper publication.), including diverse gestures with more sample numbers per gesture class. Furthermore, we provide hand annotations, including a hand bounding box, 3D hand keypoints, and gesture label per sample. The proposed dataset aims to provide a benchmark for research works to tackle real-world situations. The dataset samples are recorded in a real-world background with high complexity and diversity. To be more realistic, the proposed dataset does not include any pre-processing step. All of the samples in this dataset are pure and real. This configuration makes room to underpin future research works in a real-world situation and develop gesture recognition models in an unrestricted environment. Overall, our dataset outperforms in terms of diversity, number of subjects, number of samples per gesture class, and use of real data. Finally, different analysis on the existing state-of-the-art models in HGR, HPE, hand recovery, and hand reconstruction were performed and reported. Our implementation is available at https://github.com/smohammadi96/Diverse_hand_gesture_dataset/blob/main/README.md.
引用
收藏
页码:50245 / 50267
页数:23
相关论文
共 50 条
  • [1] Diverse hand gesture recognition dataset
    Zahra Mohammadi
    Alireza Akhavanpour
    Razieh Rastgoo
    Mohammad Sabokrou
    Multimedia Tools and Applications, 2024, 83 : 50245 - 50267
  • [2] SHAPE: a dataset for hand gesture recognition
    Dang, Tuan Linh
    Nguyen, Huu Thang
    Dao, Duc Manh
    Nguyen, Hoang Vu
    Luong, Duc Long
    Nguyen, Ba Tuan
    Kim, Suntae
    Monet, Nicolas
    Neural Computing and Applications, 2022, 34 (24) : 21849 - 21862
  • [3] SHAPE: a dataset for hand gesture recognition
    Dang, Tuan Linh
    Nguyen, Huu Thang
    Dao, Duc Manh
    Nguyen, Hoang Vu
    Luong, Duc Long
    Nguyen, Ba Tuan
    Kim, Suntae
    Monet, Nicolas
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (24): : 21849 - 21862
  • [4] SHAPE: a dataset for hand gesture recognition
    Tuan Linh Dang
    Huu Thang Nguyen
    Duc Manh Dao
    Hoang Vu Nguyen
    Duc Long Luong
    Ba Tuan Nguyen
    Suntae Kim
    Nicolas Monet
    Neural Computing and Applications, 2022, 34 : 21849 - 21862
  • [5] Hand posture dataset creation for gesture recognition
    Anton-Canalis, Luis
    Sanchez-Nielsen, Elena
    VISAPP 2006: PROCEEDINGS OF THE FIRST INTERNATIONAL CONFERENCE ON COMPUTER VISION THEORY AND APPLICATIONS, VOL 2, 2006, : 197 - +
  • [6] Gesture Recognition on a New Multi-Modal Hand Gesture Dataset
    Schak, Monika
    Gepperth, Alexander
    PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION APPLICATIONS AND METHODS (ICPRAM), 2021, : 122 - 131
  • [7] Hand Component Decomposition for the Hand Gesture Recognition Based on FingerPaint Dataset
    Na, In Seop
    Kim, Soo Hyung
    Lee, Chil Woo
    Duong, Nguyen Hai
    2019 ELEVENTH INTERNATIONAL CONFERENCE ON UBIQUITOUS AND FUTURE NETWORKS (ICUFN 2019), 2019, : 564 - 566
  • [8] Gesture Recognition and Multi-modal Fusion on a New Hand Gesture Dataset
    Schak, Monika
    Gepperth, Alexander
    PATTERN RECOGNITION APPLICATIONS AND METHODS, ICPRAM 2021, ICPRAM 2022, 2023, 13822 : 76 - 97
  • [9] DATE: a video dataset and benchmark for dynamic hand gesture recognition
    Dang T.L.
    Pham T.H.
    Dao D.M.
    Nguyen H.V.
    Dang Q.M.
    Nguyen B.T.
    Monet N.
    Neural Computing and Applications, 2024, 36 (28) : 17311 - 17325
  • [10] EgoGesture: A New Dataset and Benchmark for Egocentric Hand Gesture Recognition
    Zhang, Yifan
    Cao, Congqi
    Cheng, Jian
    Lu, Hanqing
    IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (05) : 1038 - 1050