Human Activity Recognition Method Based on FMCW Radar Sensor with Multi-Domain Feature Attention Fusion Network

被引:8
作者
Cao, Lin [1 ,2 ]
Liang, Song [1 ,2 ]
Zhao, Zongmin [1 ,2 ]
Wang, Dongfeng [3 ]
Fu, Chong [4 ]
Du, Kangning [1 ,2 ]
机构
[1] Beijing Informat Sci & Technol Univ, Key Lab Informat & Commun Syst, Minist Informat Ind, Beijing 100101, Peoples R China
[2] Beijing Informat Sci & Technol Univ, Key Lab, Minist Educ Optoelect Measurement Technol & Instru, Beijing 100101, Peoples R China
[3] Beijing TransMicrowave Technol Co, Beijing 100080, Peoples R China
[4] Northeastern Univ, Sch Comp Sci & Engn, Shenyang 110169, Peoples R China
基金
美国国家科学基金会;
关键词
human activity recognition; attention mechanism; multi-domain feature fusion; multi-classification focus loss; FMCW radar sensor; NEURAL-NETWORK; CLASSIFICATION; CHANNEL;
D O I
10.3390/s23115100
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This paper proposes a human activity recognition (HAR) method for frequency-modulated continuous wave (FMCW) radar sensors. The method utilizes a multi-domain feature attention fusion network (MFAFN) model that addresses the limitation of relying on a single range or velocity feature to describe human activity. Specifically, the network fuses time-Doppler (TD) and time-range (TR) maps of human activities, resulting in a more comprehensive representation of the activities being performed. In the feature fusion phase, the multi-feature attention fusion module (MAFM) combines features of different depth levels by introducing a channel attention mechanism. Additionally, a multi-classification focus loss (MFL) function is applied to classify confusable samples. The experimental results demonstrate that the proposed method achieves 97.58% recognition accuracy on the dataset provided by the University of Glasgow, UK. Compared to existing HAR methods for the same dataset, the proposed method showed an improvement of about 0.9-5.5%, especially in the classification of confusable activities, showing an improvement of up to 18.33%.
引用
收藏
页数:25
相关论文
共 47 条
  • [1] Activity Classification Based on Feature Fusion of FMCW Radar Human Motion Micro-Doppler Signatures
    Abdu, Fahad Jibrin
    Zhang, Yixiong
    Deng, Zhenmiao
    [J]. IEEE SENSORS JOURNAL, 2022, 22 (09) : 8648 - 8662
  • [2] Maximum Entropy Markov Model for Human Activity Recognition Using Depth Camera
    Alrashdi, Ibrahim
    Siddiqi, Muhammad Hameed
    Alhwaiti, Yousef
    Alruwaili, Madallah
    Azad, Mohammad
    [J]. IEEE ACCESS, 2021, 9 : 160635 - 160645
  • [3] A Convolutional Neural Network for Human Motion Recognition and Classification Using a Millimeter-Wave Doppler Radar
    Arab, Homa
    Ghaffari, Iman
    Chioukh, Lydia
    Tatu, Serioja Ovidiu
    Dufour, Steven
    [J]. IEEE SENSORS JOURNAL, 2022, 22 (05) : 4494 - 4502
  • [4] Radar-Based Human Gait Recognition Using Dual-Channel Deep Convolutional Neural Network
    Bai, Xueru
    Hui, Ye
    Wang, Li
    Zhou, Feng
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (12): : 9767 - 9778
  • [5] Campbell C, 2020, 2020 IEEE INTERNATIONAL RADAR CONFERENCE (RADAR), P990, DOI [10.1109/RADAR42522.2020.9114787, 10.1109/radar42522.2020.9114787]
  • [6] DIAT-RadHARNet: A Lightweight DCNN for Radar Based Classification of Human Suspicious Activities
    Chakraborty, Mainak
    Kumawat, Harish C.
    Dhavale, Sunita Vikrant
    Raj, Arockia Bazil A.
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [7] A Multi-Domain Fusion Human Motion Recognition Method Based on Lightweight Network
    Chen, Pengyun
    Jian, Qiang
    Wu, Peilun
    Guo, Shisheng
    Cui, Guolong
    Jiang, Chaoshu
    Kong, Lingjiang
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [8] Personnel Recognition and Gait Classification Based on Multistatic Micro-Doppler Signatures Using Deep Convolutional Neural Networks
    Chen, Zhaoxi
    Li, Gang
    Fioranelli, Francesco
    Griffiths, Hugh
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2018, 15 (05) : 669 - 673
  • [9] A Lightweight Framework for Human Activity Recognition on Wearable Devices
    Coelho, Yves Luduvico
    Souza dos Santos, Francisco de Assis
    Frizera-Neto, Anselmo
    Bastos-Filho, Teodiano Freire
    [J]. IEEE SENSORS JOURNAL, 2021, 21 (21) : 24471 - 24481
  • [10] Radar-Based Human Activity Recognition Using Hybrid Neural Network Model With Multidomain Fusion
    Ding, Wen
    Guo, Xuemei
    Wang, Guoli
    [J]. IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2021, 57 (05) : 2889 - 2898