24GHz FMCW Radar Based Lightweight Real-time Hand Gesture Recognition System

被引：0
|
作者：
Song, Xinghui [1 ]
Liu, Ruizhi [1 ]
Jiang, Botao [1 ]
Lin, Yue [2 ]
Xu, Hongtao [1 ]
机构：
[1] Fudan Univ, State Key Lab ASIC & Syst, Shanghai, Peoples R China
[2] ICLegend Micro, Suzhou, Peoples R China
来源：
2024 IEEE MTT-S INTERNATIONAL WIRELESS SYMPOSIUM, IWS 2024 | 2024年
关键词：
millimeter wave radar; hand gesture recognition; lightweight neural network; point cloud; super precision;
D O I：
10.1109/IWS61525.2024.10713775
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
In this paper, we propose a lightweight real-time gesture recognition system based on hand trajectory caught by 24GHz FMCW radar. To catch a reliable hand trajectory, we employ a computationally efficient local interpolation method to achieve super-precision positioning of the hand. Combined with lightweight neural networks for gesture capture and classification, high accuracy is achieved with minimal computational and resource consumption. After data augmentation for training, validation accuracy for 10 gestures can reach 97.5%, with the entire parameter size of only 0.02MB. The entire process from receiving raw radar data to outputting gesture recognition results takes only 6ms on a low-cost Microcontroller Unit.
引用
收藏
页数：3
相关论文
共 50 条
  • [21] Demo: Efficient Convolutional Neural Network for FMCW Radar Based Hand Gesture Recognition
    Cai, Xiaodong
    Ma, Jingyi
    Liu, Wei
    Han, Hemin
    Ma, Lili
    UBICOMP/ISWC'19 ADJUNCT: PROCEEDINGS OF THE 2019 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2019 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, 2019, : 17 - 20
  • [22] Two Dimensional Parameters Based Hand Gesture Recognition Algorithm for FMCW Radar Systems
    Wang, Yong
    Zhao, Zedong
    Zhou, Mu
    Wu, Jinjun
    WIRELESS AND SATELLITE SYSTEMS, PT I, 2019, 280 : 226 - 234
  • [23] A Lightweight Hand-Gesture Recognition Network With Feature Fusion Prefiltering and FMCW Radar Spatial Angle Estimation
    Chen, Jingxuan
    Guo, Shisheng
    Lv, Shuo
    Cui, Guolong
    Kong, Lingjiang
    IEEE SENSORS JOURNAL, 2024, 24 (17) : 27926 - 27936
  • [24] Real-time Pattern Recognition for Hand Gesture Based on ANN and Surface EMG
    Yang, Kuo
    Zhang, Zhen
    PROCEEDINGS OF 2019 IEEE 8TH JOINT INTERNATIONAL INFORMATION TECHNOLOGY AND ARTIFICIAL INTELLIGENCE CONFERENCE (ITAIC 2019), 2019, : 799 - 802
  • [25] REAL-TIME HAND GESTURE RECOGNITION USING RANGE CAMERAS
    Lahamy, Herve
    Litchi, Derek
    2010 CANADIAN GEOMATICS CONFERENCE AND SYMPOSIUM OF COMMISSION I, ISPRS CONVERGENCE IN GEOMATICS - SHAPING CANADA'S COMPETITIVE LANDSCAPE, 2010, 38
  • [26] Real-Time Hand Gesture Recognition using Motion Tracking
    Chi-Man Pun
    Hong-Min Zhu
    Wei Feng
    International Journal of Computational Intelligence Systems, 2011, 4 (2) : 277 - 286
  • [27] Real-Time Hand Gesture Recognition using Motion Tracking
    Pun, Chi-Man
    Zhu, Hong-Min
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2011, 4 (02) : 277 - 286
  • [28] Improving Real-Time Hand Gesture Recognition with Semantic Segmentation
    Benitez-Garcia, Gibran
    Prudente-Tixteco, Lidia
    Castro-Madrid, Luis Carlos
    Toscano-Medina, Rocio
    Olivares-Mercado, Jesus
    Sanchez-Perez, Gabriel
    Villalba, Luis Javier Garcia
    SENSORS, 2021, 21 (02) : 1 - 16
  • [29] A Real-time Hand Gesture Recognition System on Raspberry Pi: A Deep Learning-based Approach
    Yu, Alyssa
    Qian, Cheng
    Guo, Yifan
    2024 IEEE 21ST CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE, CCNC, 2024, : 499 - 506
  • [30] A real-time hand gesture recognition system for daily information retrieval from the internet
    Tsai, Joseph C.
    Chang, Shih-Ming
    Yen, Shwu-Huey
    Li, Kuan-Ching
    Chen, Yung-Hui
    Shih, Timothy K.
    INTERNATIONAL JOURNAL OF COMPUTATIONAL SCIENCE AND ENGINEERING, 2015, 11 (02) : 105 - 113
12345