Hand Gesture Recognition for Virtual Mouse Control

被引：0

作者：

Magrouni, Issam El ^{[1
]}

Ettaoufik, Abdelaziz ^{[2
]}

Aouad, Siham ^{[3
]}

Maizate, Abderrahim ^{[1
]}

机构：

[1] RITM-ESTC/CED-ENSEM, Hassan II University, Casablanca

[2] LTIM, FS ben M’SICK, Hassan II University, Casablanca

[3] SSL ENSIAS, Mohamed V University, Rabat

来源：

International Journal of Interactive Mobile Technologies | 2025年 / 19卷 / 02期

关键词：

fingertip tracking; gesture recognition; hand gesture monitoring; human-computer interaction (HCI); !text type='python']python[!/text; virtual mouse; webcam interface;

D O I：

10.3991/ijim.v19i02.51879

中图分类号：

学科分类号：

摘要：

Our work delved into the complexities of real-time hand motion interpretation and fingertip recognition to simulate the functionality of a traditional mouse. We developed a python-based technique that seamlessly translates hand movements into mouse commands by analyzing the angles between fingers and calculating the ratio of the hand’s silhouette to its convex hull. Our methodology was refined to ensure an intuitive and accurate user experience. However, challenges remained in achieving robustness and accuracy in gesture recognition systems in various scenarios, including variations in lighting, hand orientation, and individual human characteristics. These factors had a significant impact on system performance and reliability. To address these challenges, our approach incorporated the algorithms and machine learning models designed to adapt to different conditions. Despite these advances, further research and development were essential to improve the reliability and comprehensiveness of gesture recognition technologies. © 2025 by the authors of this article.

引用

页码：53 / 64

页数：11

共 11 条

[1]

Katona J., A review of human–computer interaction and virtual reality research fields in cognitive InfoCommunications, Applied Sciences, 11, 6, (2021)

[2]

Shriram S., Nagaraj B., Jaya J., Shankar S., Ajay P., Deep learning-based real-time AI virtual mouse system using computer vision to avoid COVID-19 spread, Journal of Healthcare Engineering, 2021, pp. 1-8, (2021)

[3]

Zhang L., Tian Q., Ruan Q., Shi Z., A simple and effective static gesture recognition method based on attention mechanism, Journal of Visual Communication and Image Representation, 92, (2023)

[4]

Biswas K. K., Basu S. K., Gesture recognition using Microsoft Kinect®, The 5th International Conference on Automation, Robotics and Applications, pp. 100-103, (2011)

[5]

Liu Y., Chiu M. Y., Li H. L., Wu K. H., Lei Z., Ding Q., A real time robust hand tracking method with normal cameras, Computer Vision. CCCV 2015. Communications in Computer and Information Science, 546, (2015)

[6]

Zhang Y., Liu B., Liu Z., Recognizing hand gestures with pressure-sensor-based motion sensing, IEEE Transactions on Biomedical Circuits and Systems, 13, 6, pp. 1425-1436, (2019)

[7]

Li Y., Et al., A dynamic hand gesture recognition model based on the improved dynamic time warping algorithm, 2019 25th International Conference on Automation and Computing (ICAC), pp. 1-6, (2019)

[8]

Jo B. J., Kim S.-K., Kim S., Enhancing virtual and augmented reality interactions with a MediaPipe-based hand gesture recognition user interface, Ingénierie des Systèmes d’Information, 28, 3, pp. 633-638, (2023)

[9]

Shibly K. H., Kumar Dey S., Islam M. A., Iftekhar Showrav S., Design and development of hand gesture based virtual mouse, Proceedings of the 2019 1st International Conference on Advances in Science, Engineering and Robotics Technology (ICASERT), pp. 1-5, (2019)

[10]

Tran D.-S., Ho N.-H., Yang H.-J., Kim S.-H., Lee G. S., Real-time virtual mouse system using RGB-D images and fingertip detection, Multimedia Tools and Applications Multimedia Tools and Applications, 80, 7, pp. 10473-10490, (2021)

← 1 2 →