Continuous Human Action Recognition by Multiple-Object-Detection-Based FMCW Radar

被引:2
作者
Yin, Wei [1 ]
Shi, Lingfeng [1 ]
Shi, Yifan [2 ]
机构
[1] Xidian Univ, Sch Elect Engn, Xian 710071, Peoples R China
[2] Queens Univ, Dept Mech & Mat Engn, Kingston, ON K7L 3N6, Canada
关键词
Radar; Feature extraction; Accuracy; Human activity recognition; Radar equipment; Radar detection; Convolutional neural networks; HUMAN-MOTION RECOGNITION; MICRO-DOPPLER SIGNATURES; NEURAL-NETWORK; CLASSIFICATION; MODEL;
D O I
10.1109/TAES.2024.3427101
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
A continuous human activity recognition method based on the multiobject recognition (MOR) method, the constructed lightweight network (LNet), and the proposed one-dimensional bounding loss (ODBL) function, the MOR LNet ODBL (MOR-LNOD) method, is proposed. The method is validated using continuous action sequences involving nine participants and eight different actions. We interpret each action in the sequence as a single target and utilize a multiobject detection method for accurate single-action region selection, followed by recognition and classification. Based on the results of the study, the MOR-LNOD method is 96.5% accurate on average, which is an improvement of about 20% compared with previous methods based on recurrent neural networks. Compared to the ResNet 50 and MobileNet used in the traditional faster region-based convolutional neural network, the proposed network architecture has reduced the parameters by ten and two times, respectively. As compared to state of the art (SOTA) on the publicly available dataset, MOR-LNOD not only reduces the requirement of input data but also has a higher average accuracy than SOTA.
引用
收藏
页码:8289 / 8297
页数:9
相关论文
共 36 条
[1]   Automatic Arm Motion Recognition Using Radar for Smart Home Technologies [J].
Amin, Moeness G. ;
Zeng, Zhengxin ;
Shan, Tao ;
Guendel, Ronny G. .
2019 INTERNATIONAL RADAR CONFERENCE (RADAR2019), 2019, :624-627
[2]   Radar-Based Human Gait Recognition Using Dual-Channel Deep Convolutional Neural Network [J].
Bai, Xueru ;
Hui, Ye ;
Wang, Li ;
Zhou, Feng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (12) :9767-9778
[3]   Human-in-the-Loop Consensus Tracking Control for UAV Systems via an Improved Prescribed Performance Approach [J].
Chen, Lei ;
Liang, Hongjing ;
Pan, Yingnan ;
Li, Tieshan .
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2023, 59 (06) :8380-8391
[4]   DopNet: A Deep Convolutional Neural Network to Recognize Armed and Unarmed Human Targets [J].
Chen, Qingchao ;
Liu, Yang ;
Fioranelli, Francesco ;
Ritchie, Matthew ;
Tan, Bo ;
Chetty, Kevin .
IEEE SENSORS JOURNAL, 2019, 19 (11) :4160-4172
[5]   Personnel Recognition and Gait Classification Based on Multistatic Micro-Doppler Signatures Using Deep Convolutional Neural Networks [J].
Chen, Zhaoxi ;
Li, Gang ;
Fioranelli, Francesco ;
Griffiths, Hugh .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2018, 15 (05) :669-673
[6]   Continuous Human Motion Recognition With a Dynamic Range-Doppler Trajectory Method Based on FMCW Radar [J].
Ding, Chuanwei ;
Hong, Hong ;
Zou, Yu ;
Chu, Hui ;
Zhu, Xiaohua ;
Fioranelli, Francesco ;
Le Kernec, Julien ;
Li, Changzhi .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (09) :6821-6831
[7]   Continuous Human Activity Recognition through Parallelism LSTM with Multi-Frequency Spectrograms [J].
Ding, Congzhang ;
Jia, Yong ;
Cui, Guolong ;
Chen, Chuan ;
Zhong, Xiaoling ;
Guo, Yong .
REMOTE SENSING, 2021, 13 (21)
[8]   Radar-Based Human Activity Recognition Using Hybrid Neural Network Model With Multidomain Fusion [J].
Ding, Wen ;
Guo, Xuemei ;
Wang, Guoli .
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2021, 57 (05) :2889-2898
[9]   Human Motion Recognition Using Doppler Radar Based on Semi-Supervised Learning [J].
Ding, Yipeng ;
Jin, Bo ;
Zhang, Jiawei ;
Liu, Runjin ;
Zhang, Yongfu .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[10]   Motion Classification Using Kinematically Sifted ACGAN-Synthesized Radar Micro-Doppler Signatures [J].
Erol, Baris ;
Gurbuz, Sevgi Zubyede ;
Amin, Moeness G. .
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2020, 56 (04) :3197-3213