Spiking Neural Networks for Gesture Recognition Using Time Domain Radar Data

被引：0

作者：

Shaaban, Ahmed ^{[1
,2
]}

Furtner, Wolfgang ^{[1
]}

Weigel, Robert ^{[2
]}

Lurz, Fabian ^{[2
]}

机构：

[1] Infineon Technol AG, Munich, Germany

[2] Univ Erlangen Nurnberg, Inst Elect Engn, Erlangen, Germany

来源：

2022 19TH EUROPEAN RADAR CONFERENCE (EURAD) | 2022年

关键词：

Spiking Neural Networks; Radar Gesture Recognition; Convolutional Neural Networks; FMCW Radar; Raw Radar Data; Time Domain Radar Data;

D O I：

暂无

中图分类号：

TM [电工技术]; TN [电子技术、通信技术];

学科分类号：

0808 ; 0809 ;

摘要：

Gesture recognition using luminance invariant radar sensors is vital due to its extensive use in human-machine interfaces. However, the necessity for computationally expensive radar data pre-processing steps represented by fast Fourier transforms to get range and Doppler features are regarded as a contemporary concern. In this work, we present a solution for gesture recognition that relies on time-domain radar data applied to an event-driven, sparse, and end-to-end trained spiking neural network architecture. Using the proposed solution, it is possible to discriminate between 10 different gestures in a gesture dataset recorded using a 60 GHz frequency-modulated continuous-wave radar sensor, with a mean test accuracy of 93.1%.

引用

页码：33 / 36

页数：4

共 50 条

[31] Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition [J].

Cao, Yongqiang ;

Chen, Yang ;

Khosla, Deepak .

INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 113 (01) :54-66

[32] Contactless Low Power Air-Writing Based on FMCW Radar Networks Using Spiking Neural Networks [J].

Arsalan, Muhammad ;

Zheng, Tao ;

Santra, Avik ;

Issakov, Vadim .

2022 21ST IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, ICMLA, 2022, :931-935

[33] Touchless Recognition of Hand Gesture Digits and English Characters Using Convolutional Neural Networks [J].

Peshin, Ujjwal ;

Jha, Tanay ;

Kantival, Shivam .

MACHINE LEARNING FOR NETWORKING, 2019, 11407 :212-221

[34] Modelling and Analysis of Temporal Gene Expression Data Using Spiking Neural Networks [J].

Nandini, Durgesh ;

Capecci, Elisa ;

Koefoed, Lucien ;

Lana, Ibai ;

Shahi, Gautam Kishore ;

Kasabov, Nikola .

NEURAL INFORMATION PROCESSING (ICONIP 2018), PT I, 2018, 11301 :571-581

[35] Physically-Interpretable Data Augmentation for Multi-Range Hand Gesture Recognition Using FMCW Radar Time Series [J].

Hassab, Youcef ;

Stadelmayer, Thomas ;

Lurz, Fabian .

IEEE TRANSACTIONS ON RADAR SYSTEMS, 2023, 1 :571-582

[36] FPGA Implementation of Izhikevich Spiking Neural Networks for Character Recognition [J].

Rice, Kenneth L. ;

Bhuiyan, Mohammad A. ;

Taha, Tarek M. ;

Vutsinas, Christopher N. ;

Smith, Melissa C. .

2009 INTERNATIONAL CONFERENCE ON RECONFIGURABLE COMPUTING AND FPGAS, 2009, :451-+

[37] Improved Spiking Neural Networks with multiple neurons for digit recognition [J].

Chimmula, Vinay Kumar Reddy ;

Zhang, Lei ;

Palliath, Dhanya ;

Kumar, Abhinay .

2020 11TH INTERNATIONAL CONFERENCE ON AWARENESS SCIENCE AND TECHNOLOGY (ICAST), 2020,

[38] A critical survey of STDP in Spiking Neural Networks for Pattern Recognition [J].

Vigneron, Alex ;

Martinet, Jean .

2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,

[39] Deep Dynamic Neural Networks for Multimodal Gesture Segmentation and Recognition [J].

Wu, Di ;

Pigou, Lionel ;

Kindermans, Pieter-Jan ;

Nam Do-Hoang Le ;

Shao, Ling ;

Dambre, Joni ;

Odobez, Jean-Marc .

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (08) :1583-1597

[40] A TIME ENCODING APPROACH TO TRAINING SPIKING NEURAL NETWORKS [J].

Adam, Karen .

2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, :5957-5961

← 1 2 3 4 5 →