The Use of Hand Gestures as a Tool for Presentation

被引:0
作者
Orovwode, Hope [1 ]
Abubakar, John Amanesi [2 ]
Gaius, Onuora Chidera [1 ]
Abdullkareem, Ademola [1 ]
机构
[1] Covenant Univ, Dept Elect & Informat Engn, Ota, Ogun, Nigeria
[2] Univ Bologna, Dept Comp Sci & Engn, Bologna, BO, Italy
关键词
-Hand gesture; linear classifier; motion classifier; LSTM; interface; RECOGNITION;
D O I
10.14569/IJACSA.2023.0141159
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Or hands play a crucial role in daily activities, serving as a primary tool for interacting with technology. This paper explores using hand gestures to control presentations, offering a dynamic alternative to traditional devices like mice or keyboards. These conventional methods often limit presenters to a fixed position and depend on the device's proximity. In contrast, hand gesture controls promise a more fluid and engaging presentation style. This study utilizes the HaGRID dataset, supplemented by custom-recorded data, divided into 80% for training, and 10% each for validation and testing. The data undergoes preprocessing and a linear classifier with four dense layers and a SoftMax activation layer is employed. The model, optimized with the Adam optimizer and a learning rate of 1e-1, incorporates a motion classifier (LSTM) with two dense layers and an LSTM layer, tailored for long-distance body pose estimation. The resulting application, a local desktop tool independent of internet connectivity, uses tkinter for its user interface. It demonstrates high accuracy in classifying gestures, achieving 90.1%, 89%, and 90% in training, validation, and testing, respectively, for the linear classifier. The motion classifier records 79.8%, 72%, and 70.1%. The model effectively recognizes and categorizes dataset gestures, capturing live camera feeds to manage presentations. Users benefit from various features, including PowerPoint selection, distance mode, gesture toggling and assignment, and appearance mode. This study illustrates how hand gesture control can enhance presentation experiences, merging technology with natural human movement for a more seamless interaction.
引用
收藏
页码:574 / 585
页数:12
相关论文
共 30 条
[1]  
Alausa Dele W., 2023, 2023 IEEE 3rd International Conference on Power, Electronics and Computer Applications (ICPECA), P318, DOI 10.1109/ICPECA56706.2023.10076097
[2]  
Alausa D. W., 2022, IEEE Access, V10
[3]  
Ballotta D, 2010, Public speaking and presentations a critical review: The caring speaker
[4]  
Benke L., 2016, Reconstr. Stud. Contemp. Cult., V16
[5]   The Challenge of Abstract Concepts [J].
Borghi, Anna M. ;
Binkofski, Ferdinand ;
Castelfranchi, Cristiano ;
Cimatti, Felice ;
Scorolli, Claudia ;
Tummolini, Luca .
PSYCHOLOGICAL BULLETIN, 2017, 143 (03) :263-292
[6]   An Efficient Hand Gesture Recognition System Based on Deep CNN [J].
Chung, Hung-Yuan ;
Chung, Yao-Liang ;
Tsai, Wei-Feng .
2019 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY (ICIT), 2019, :853-858
[7]   Recent trends in gesture recognition: how depth data has improved classical approaches [J].
D'Orazio, T. ;
Marani, R. ;
Reno, V. ;
Cicirelli, G. .
IMAGE AND VISION COMPUTING, 2016, 52 :56-72
[8]  
Daly A., 1995, A Cultural History of Gesture, V39, DOI [10.2307/1146410, DOI 10.2307/1146410]
[9]  
Darwin C., 2009, The Expression of the Emotions in Man and Animals, V2, DOI DOI 10.1017/CBO9780511694110
[10]  
Dhall I, 2020, PROCEEDINGS OF THE CONFLUENCE 2020: 10TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, DATA SCIENCE & ENGINEERING, P811, DOI [10.1109/confluence47617.2020.9057853, 10.1109/Confluence47617.2020.9057853]