24GHz FMCW Radar Based Lightweight Real-time Hand Gesture Recognition System

被引:0
|
作者
Song, Xinghui [1 ]
Liu, Ruizhi [1 ]
Jiang, Botao [1 ]
Lin, Yue [2 ]
Xu, Hongtao [1 ]
机构
[1] Fudan Univ, State Key Lab ASIC & Syst, Shanghai, Peoples R China
[2] ICLegend Micro, Suzhou, Peoples R China
来源
2024 IEEE MTT-S INTERNATIONAL WIRELESS SYMPOSIUM, IWS 2024 | 2024年
关键词
millimeter wave radar; hand gesture recognition; lightweight neural network; point cloud; super precision;
D O I
10.1109/IWS61525.2024.10713775
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this paper, we propose a lightweight real-time gesture recognition system based on hand trajectory caught by 24GHz FMCW radar. To catch a reliable hand trajectory, we employ a computationally efficient local interpolation method to achieve super-precision positioning of the hand. Combined with lightweight neural networks for gesture capture and classification, high accuracy is achieved with minimal computational and resource consumption. After data augmentation for training, validation accuracy for 10 gestures can reach 97.5%, with the entire parameter size of only 0.02MB. The entire process from receiving raw radar data to outputting gesture recognition results takes only 6ms on a low-cost Microcontroller Unit.
引用
收藏
页数:3
相关论文
共 50 条
  • [41] Real-Time Analysis of Hand Gesture Recognition with Temporal Convolutional Networks
    Tsinganos, Panagiotis
    Jansen, Bart
    Cornelis, Jan
    Skodras, Athanassios
    SENSORS, 2022, 22 (05)
  • [42] REAL-TIME VISUAL STATIC HAND GESTURE RECOGNITION SYSTEM AND ITS FPGABASED HARDWARE IMPLEMENTATION
    Wang Ran
    Yu Zhishuai
    Liu Minghang
    Wang Yikai
    Chang Yuchun
    2014 12TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP), 2014, : 434 - 439
  • [43] A Lightweight Remote Gesture Recognition System with Body-motion Suppression and Foreground Segmentation Using FMCW Radar
    Chen, Jingxuan
    Wu, Yajie
    Zhang, Bo
    Guo, Shisheng
    Cui, Guolong
    APSIPA TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING, 2024, 13 (04)
  • [44] Survey on Real Time Hand Gesture Recognition
    Kakkoth, Sarang Suresh
    Gharge, Saylee
    2017 INTERNATIONAL CONFERENCE ON CURRENT TRENDS IN COMPUTER, ELECTRICAL, ELECTRONICS AND COMMUNICATION (CTCEEC), 2017, : 948 - 954
  • [45] Real Time Static Hand Gesture Recognition System for Mobile Devices
    Lahiani, Houssem
    Elleuch, Mohamed
    Kherallah, Monji
    JOURNAL OF INFORMATION ASSURANCE AND SECURITY, 2016, 11 (02): : 67 - 76
  • [46] Quantized CNN-based efficient hardware architecture for real-time hand gesture recognition
    Jaiswal, Mohita
    Sharma, Vaidehi
    Sharma, Abhishek
    Saini, Sandeep
    Tomar, Raghuvir
    MICROELECTRONICS JOURNAL, 2024, 151
  • [47] Real-Time Hand Gesture Recognition: A Comprehensive Review of Techniques, Applications, and Challenges
    Mohamed, Aws Saood
    Hassan, Nidaa Flaih
    Jamil, Abeer Salim
    CYBERNETICS AND INFORMATION TECHNOLOGIES, 2024, 24 (03) : 163 - 181
  • [48] Real-Time Hand Gesture Recognition with Kinect for Playing Racing Video Games
    Zhu, Yanmin
    Yuan, Bo
    PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, : 3240 - 3246
  • [49] HIDDEN MARKOV MODEL-BASED GESTURE RECOGNITION WITH FMCW RADAR
    Malysa, Greg
    Wang, Dan
    Netsch, Lorin
    Ali, Murtaza
    2016 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP), 2016, : 1017 - 1021
  • [50] Real-Time Single Camera Hand Gesture Recognition System for Remote Deaf-Blind Communication
    Farulla, Giuseppe Airo
    Russo, Ludovico Orlando
    Pintor, Chiara
    Pianu, Daniele
    Micotti, Giorgio
    Salgarella, Alice Rita
    Camboni, Domenico
    Controzzi, Marco
    Cipriani, Christian
    Oddo, Calogero Maria
    Rosa, Stefano
    Indaco, Marco
    AUGMENTED AND VIRTUAL REALITY, AVR 2014, 2014, 8853 : 35 - 52