Analysis of Edge-Optimized Deep Learning Classifiers for Radar-Based Gesture Recognition

被引:17
作者
Chmurski, Mateusz [1 ,2 ]
Zubert, Mariusz [2 ]
Bierzynski, Kay [1 ]
Santra, Avik [1 ]
机构
[1] Infineon Technol AG, D-85579 Neubiberg, Germany
[2] Lodz Univ Technol, Dept Microelect & Comp Sci, PL-90924 Lodz, Poland
关键词
Optimization; Deep learning; Training; Sensors; Topology; Gesture recognition; Data models; Accelerator; data augmentation; edge computing; FMCW; gesture recognition; neural networks; DNNs; optimization; radar; intel NCS2;
D O I
10.1109/ACCESS.2021.3081353
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The increasing significance of technology in daily lives led to the need for the development of convenient methods of human-computer interaction (HCI). Given that the existing HCI approaches exhibit various limitations, hand gesture recognition-based HCI may serve as a more intuitive mode of human-machine interaction in many situations. In addition, the system has to be deployable on low-power devices for applicability in broadly defined Internet of Things (IoT) and smart home solutions. Recent advances exhibit the potential of deep learning models for gesture classification, whereas they are still limited to high-performance hardware. Embedded neural network accelerators are constrained in terms of available memory, central processing unit (CPU) clock speed, graphics processing unit (GPU) performance, and a number of supported operations. The aforementioned problems are addressed in this paper by namely two approaches - simplifying the signal processing pipeline to avoid recurrent structures and efficient topological design. This paper employs an intuitive scheme allowing for the generation of the data in the compressed form from the sequence of range-Doppler images (RDI). Thus, it allows for the design of a neural classifier avoiding the usage of recurrent layers. The proposed framework has been optimized for Intel(R) Neural Compute Stick 2 (Intel(R) NCS 2), at the same time achieving promising classification accuracy of 97.57%. To confirm the robustness of the proposed algorithm, five independent persons have been involved in the algorithm testing process.
引用
收藏
页码:74406 / 74421
页数:16
相关论文
共 52 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]   Hand Gesture Recognition Using an IR-UWB Radar with an Inception Module-Based Classifier [J].
Ahmed, Shahzad ;
Cho, Sung Ho .
SENSORS, 2020, 20 (02)
[3]  
Al-Janabi, 2019, REV J, V5, P368
[4]   Gesture-based Control in a Smart Home Environment [J].
Alemuda, Fariz ;
Lin, Fuchun Joseph .
2017 IEEE INTERNATIONAL CONFERENCE ON INTERNET OF THINGS (ITHINGS) AND IEEE GREEN COMPUTING AND COMMUNICATIONS (GREENCOM) AND IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING (CPSCOM) AND IEEE SMART DATA (SMARTDATA), 2017, :784-791
[5]   A State-of-the-Art Survey on Deep Learning Theory and Architectures [J].
Alom, Md Zahangir ;
Taha, Tarek M. ;
Yakopcic, Chris ;
Westberg, Stefan ;
Sidike, Paheding ;
Nasrin, Mst Shamima ;
Hasan, Mahmudul ;
Van Essen, Brian C. ;
Awwal, Abdul A. S. ;
Asari, Vijayan K. .
ELECTRONICS, 2019, 8 (03)
[6]  
[Anonymous], 2018, INTRO TENSORFLOW INT
[7]  
[Anonymous], IMAGENET CLASSIFICAT, DOI [10.1145/3065386, DOI 10.1145/3065386]
[8]  
[Anonymous], 2020, WHAT IS ML PIP WHY I
[9]  
[Anonymous], OV ML PIP TEST DEB M
[10]  
[Anonymous], ARXIV160808710