WiDG: An Air Hand Gesture Recognition System Based on CSI and Deep Learning

被引:2
|
作者
Wang, Zhengjie [1 ]
Song, Xue [1 ]
Fan, Jingwen [1 ]
Chen, Fang [1 ]
Zhou, Naisheng [1 ]
Guo, Yinjing [1 ]
Chen, Da [1 ]
机构
[1] Shandong Univ Sci & Technol, Qingdao 266590, Peoples R China
关键词
CSI; Hand Gesture Recognition; Deep Learning Model; CNN;
D O I
10.1109/CCDC52312.2021.9602438
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Hand gesture recognition has become a hot research topic because it plays a crucial role in human-computer interaction applications. Channel State Information (CSI) is attracting more attention since it depicts more accurate communication links and can be leveraged to recognize target action in its coverage area. In this paper, we propose a device-free hand gesture recognition system based on CSI and deep learning models, called WiDG. This system can recognize handwritten digits from 0 to 9 in the air according to CSI changes caused by different hand movements. We build deep learning models to identify hand gestures. We conduct experiments in both non-through-the-wall and through-the-wall scenarios to evaluate system performance. The experimental results show that Convolutional Neural Networks (CNN) achieves 97.2% and 95.7% recognition accuracy in the non-through-the-wall scene and through-the-wall scene, respectively. In addition, we discuss the system parameters affecting recognition accuracy and compare system performance with WiNum. The results show that deep learning models can realize hand gesture recognition with a satisfactory performance using CSI.
引用
收藏
页码:1243 / 1248
页数:6
相关论文
共 50 条
  • [31] A Deep Learning-Based End-to-End Composite System for Hand Detection and Gesture Recognition
    Mohammed, Adam Ahmed Qaid
    Lv, Jiancheng
    Islam, Md. Sajjatul
    SENSORS, 2019, 19 (23)
  • [32] Deep Learning-Based Hand Gesture Recognition System and Design of a Human-Machine Interface
    Sen, Abir
    Mishra, Tapas Kumar
    Dash, Ratnakar
    NEURAL PROCESSING LETTERS, 2023, 55 (09) : 12569 - 12596
  • [33] Deep Learning-Based Approach for Sign Language Gesture Recognition With Efficient Hand Gesture Representation
    Al-Hammadi, Muneer
    Muhammad, Ghulam
    Abdul, Wadood
    Alsulaiman, Mansour
    Bencherif, Mohammed A.
    Alrayes, Tareq S.
    Mathkour, Hassan
    Mekhtiche, Mohamed Amine
    IEEE ACCESS, 2020, 8 (08): : 192527 - 192542
  • [34] Point Cloud Deep Learning Solution for Hand Gesture Recognition
    Osimani, Cesar
    Ojeda-Castelo, Juan Jesus
    Piedra-Fernandez, Jose A.
    INTERNATIONAL JOURNAL OF INTERACTIVE MULTIMEDIA AND ARTIFICIAL INTELLIGENCE, 2023, 8 (04): : 78 - 87
  • [35] Deep Fisher discriminant learning for mobile hand gesture recognition
    Li, Ce
    Xie, Chunyu
    Zhang, Baochang
    Chen, Chen
    Han, Jungong
    PATTERN RECOGNITION, 2018, 77 : 276 - 288
  • [36] A System for Hand Gesture Based Signature Recognition
    Jeon, Je-Hyoung
    Oh, Beom-Seok
    Toh, Kar-Ann
    2012 12TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS & VISION (ICARCV), 2012, : 171 - 175
  • [37] A Dynamic Hand Gesture Recognition Algorithm Based on CSI and YOLOv3
    Zhang, Qiang
    Zhang, Yong
    Liu, Zhiguo
    2019 3RD INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE, AUTOMATION AND CONTROL TECHNOLOGIES (AIACT 2019), 2019, 1267
  • [38] A Real-time Hand Gesture Recognition System on Raspberry Pi: A Deep Learning-based Approach
    Yu, Alyssa
    Qian, Cheng
    Guo, Yifan
    2024 IEEE 21ST CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE, CCNC, 2024, : 499 - 506
  • [39] Real-time Hand Gesture Recognition Based on Deep Learning in Complex Environments
    Wu, Weixin
    Shi, Meiping
    Wu, Tao
    Zhao, Dawei
    Zhang, Shuai
    Li, Junxiang
    PROCEEDINGS OF THE 2019 31ST CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2019), 2019, : 5950 - 5955
  • [40] Deep Learning-based Fast Hand Gesture Recognition using Representative Frames
    John, Vijay
    Boyali, Ali
    Mita, Seiichi
    Imanishi, Masayuki
    Sanma, Norio
    2016 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA), 2016, : 31 - 38