Camera-based interactive wall display using hand gesture recognition

被引:5
作者
Zahra, Rida [1 ]
Shehzadi, Afifa [2 ]
Sharif, Muhammad Imran [3 ]
Karim, Asif [4 ]
Azam, Sami [4 ]
De Boer, Friso [4 ]
Jonkman, Mirjam [4 ]
Mehmood, Mehwish [5 ]
机构
[1] Univ Wah, Dept Comp Sci, Wah, Pakistan
[2] Univ Lahore, Dept Comp Sci, Sargodha, Pakistan
[3] Kansas State Univ, Dept Comp Sci, Manhattan, KS USA
[4] Charles Darwin Univ, Fac Sci & Technol, Darwin, NT, Australia
[5] Queens Univ Belfast, Sch Elect Elect Engn & Comp Sci, Belfast, North Ireland
来源
INTELLIGENT SYSTEMS WITH APPLICATIONS | 2023年 / 19卷
关键词
Human-computer interaction; Euclidean distance; Convexity hull; Bare hand gestures; FEATURES;
D O I
10.1016/j.iswa.2023.200262
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
the recognition of Hand gestures has become a critical point as it is widely used in everyday applications. the challenge in this is to improve the recognition effect and develop a fast recognition method. Glove and led-based methods involve external devices in detecting and interpreting hand gestures, making human-computer interaction less natural. So, different approaches have been used previously that use purely hand gestures in many systems based on human-computer interaction. This system provides a more natural human-computer interaction; it must be made efficient processing speed of classifying the test data (images) from among the training data (database stored for gestures recognition). This speed makes gesture recognition more effective and reliable to use as compared to previously proposed methods. In this research paper, a proposed system based on a camerabased interactive wall display using bare hand gestures with efficient processing speed for controlling the speed of the mouse and other functions. This system has three modules: one uses Genetic Algorithm and Otsu thresholding to identify the query images as the right or wrong gesture and perform the correct action in case of the proper motion, another module controls functions outside of PowerPoint files or Word documents, e.g., to open folders and go through drives, and the third module uses the convexity hull method for finding the number of fingers open in the user's gesture and operates accordingly.
引用
收藏
页数:8
相关论文
共 40 条
  • [1] Human-Computer Interaction with Hand Gesture Recognition Using ResNet and MobileNet
    Alnuaim, Abeer
    Zakariah, Mohammed
    Hatamleh, Wesam Atef
    Tarazi, Hussam
    Tripathi, Vikas
    Amoatey, Enoch Tetteh
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [2] Tumor Localization and Classification from MRI of Brain using Deep Convolution Neural Network and Salp Swarm Algorithm
    Alyami, Jaber
    Rehman, Amjad
    Almutairi, Fahad
    Fayyaz, Abdul Muiz
    Roy, Sudipta
    Saba, Tanzila
    Alkhurim, Alhassan
    [J]. COGNITIVE COMPUTATION, 2024, 16 (04) : 2036 - 2046
  • [3] SequenceSense: A Tool for Designing Usable Foot-Based Gestures Using a Sequence-Based Gesture Recognizer
    Azim, Md Aashikur Rahman
    Rahman, Adil
    Heo, Seongkook
    [J]. INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 2023, 176
  • [4] Bainbridge R., 2011, P 2011 INT C BOD SEN
  • [5] CNN based feature extraction and classification for sign language
    Barbhuiya, Abul Abbas
    Karsh, Ram Kumar
    Jain, Rahul
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (02) : 3051 - 3069
  • [6] Vision-based Hand Gesture Recognition for Human-Computer Interaction using MobileNetV2
    Baumgartl, Hermann
    Sauter, Daniel
    Schenk, Christian
    Atik, Cem
    Buettner, Ricardo
    [J]. 2021 IEEE 45TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE (COMPSAC 2021), 2021, : 1667 - 1674
  • [7] Flexible pressure visualization equipment for human-computer interaction
    Bi, S.
    Jin, W.
    Han, X.
    Metts, J.
    Ostrosky, A. D.
    Lehotsky, J.
    He, Z.
    Jiang, C.
    Asare-Yeboah, K.
    [J]. MATERIALS TODAY SUSTAINABILITY, 2023, 21
  • [8] A Geometric Model-Based Approach to Hand Gesture Recognition
    Calado, Alexandre
    Roselli, Paolo
    Errico, Vito
    Magrofuoco, Nathan
    Vanderdonckt, Jean
    Saggio, Giovanni
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (10): : 6151 - 6161
  • [9] Towards Touch-Based Medical Image Diagnosis Annotation
    Calisto, Francisco M.
    Nascimento, Jacinto C.
    Ferreira, Alfredo
    Goncalves, Daniel
    [J]. PROCEEDINGS OF THE 2017 ACM INTERNATIONAL CONFERENCE ON INTERACTIVE SURFACES AND SPACES (ACM ISS 2017), 2017, : 390 - 395
  • [10] Assertiveness-based Agent Communication for a Personalized Medicine on Medical Imaging Diagnosis
    Calisto, Francisco Maria
    Fernandes, Joao
    Morais, Margarida
    Santiago, Carlos
    Abrantes, Joao Maria
    Nunes, Nuno
    [J]. PROCEEDINGS OF THE 2023 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2023, 2023,