Human Activity Recognition Method Based on FMCW Radar Sensor with Multi-Domain Feature Attention Fusion Network

被引:15
作者
Cao, Lin [1 ,2 ]
Liang, Song [1 ,2 ]
Zhao, Zongmin [1 ,2 ]
Wang, Dongfeng [3 ]
Fu, Chong [4 ]
Du, Kangning [1 ,2 ]
机构
[1] Beijing Informat Sci & Technol Univ, Key Lab Informat & Commun Syst, Minist Informat Ind, Beijing 100101, Peoples R China
[2] Beijing Informat Sci & Technol Univ, Key Lab, Minist Educ Optoelect Measurement Technol & Instru, Beijing 100101, Peoples R China
[3] Beijing TransMicrowave Technol Co, Beijing 100080, Peoples R China
[4] Northeastern Univ, Sch Comp Sci & Engn, Shenyang 110169, Peoples R China
基金
美国国家科学基金会;
关键词
human activity recognition; attention mechanism; multi-domain feature fusion; multi-classification focus loss; FMCW radar sensor; NEURAL-NETWORK; CLASSIFICATION; CHANNEL;
D O I
10.3390/s23115100
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This paper proposes a human activity recognition (HAR) method for frequency-modulated continuous wave (FMCW) radar sensors. The method utilizes a multi-domain feature attention fusion network (MFAFN) model that addresses the limitation of relying on a single range or velocity feature to describe human activity. Specifically, the network fuses time-Doppler (TD) and time-range (TR) maps of human activities, resulting in a more comprehensive representation of the activities being performed. In the feature fusion phase, the multi-feature attention fusion module (MAFM) combines features of different depth levels by introducing a channel attention mechanism. Additionally, a multi-classification focus loss (MFL) function is applied to classify confusable samples. The experimental results demonstrate that the proposed method achieves 97.58% recognition accuracy on the dataset provided by the University of Glasgow, UK. Compared to existing HAR methods for the same dataset, the proposed method showed an improvement of about 0.9-5.5%, especially in the classification of confusable activities, showing an improvement of up to 18.33%.
引用
收藏
页数:25
相关论文
共 47 条
[1]   Activity Classification Based on Feature Fusion of FMCW Radar Human Motion Micro-Doppler Signatures [J].
Abdu, Fahad Jibrin ;
Zhang, Yixiong ;
Deng, Zhenmiao .
IEEE SENSORS JOURNAL, 2022, 22 (09) :8648-8662
[2]   Maximum Entropy Markov Model for Human Activity Recognition Using Depth Camera [J].
Alrashdi, Ibrahim ;
Siddiqi, Muhammad Hameed ;
Alhwaiti, Yousef ;
Alruwaili, Madallah ;
Azad, Mohammad .
IEEE ACCESS, 2021, 9 :160635-160645
[3]   A Convolutional Neural Network for Human Motion Recognition and Classification Using a Millimeter-Wave Doppler Radar [J].
Arab, Homa ;
Ghaffari, Iman ;
Chioukh, Lydia ;
Tatu, Serioja Ovidiu ;
Dufour, Steven .
IEEE SENSORS JOURNAL, 2022, 22 (05) :4494-4502
[4]   Radar-Based Human Gait Recognition Using Dual-Channel Deep Convolutional Neural Network [J].
Bai, Xueru ;
Hui, Ye ;
Wang, Li ;
Zhou, Feng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (12) :9767-9778
[5]  
Campbell C, 2020, 2020 IEEE INTERNATIONAL RADAR CONFERENCE (RADAR), P990, DOI [10.1109/radar42522.2020.9114787, 10.1109/RADAR42522.2020.9114787]
[6]   DIAT-RadHARNet: A Lightweight DCNN for Radar Based Classification of Human Suspicious Activities [J].
Chakraborty, Mainak ;
Kumawat, Harish C. ;
Dhavale, Sunita Vikrant ;
Raj, Arockia Bazil A. .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
[7]   A Multi-Domain Fusion Human Motion Recognition Method Based on Lightweight Network [J].
Chen, Pengyun ;
Jian, Qiang ;
Wu, Peilun ;
Guo, Shisheng ;
Cui, Guolong ;
Jiang, Chaoshu ;
Kong, Lingjiang .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[8]   Personnel Recognition and Gait Classification Based on Multistatic Micro-Doppler Signatures Using Deep Convolutional Neural Networks [J].
Chen, Zhaoxi ;
Li, Gang ;
Fioranelli, Francesco ;
Griffiths, Hugh .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2018, 15 (05) :669-673
[9]   A Lightweight Framework for Human Activity Recognition on Wearable Devices [J].
Coelho, Yves Luduvico ;
Souza dos Santos, Francisco de Assis ;
Frizera-Neto, Anselmo ;
Bastos-Filho, Teodiano Freire .
IEEE SENSORS JOURNAL, 2021, 21 (21) :24471-24481
[10]   Radar-Based Human Activity Recognition Using Hybrid Neural Network Model With Multidomain Fusion [J].
Ding, Wen ;
Guo, Xuemei ;
Wang, Guoli .
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2021, 57 (05) :2889-2898