Lightweight Multi-Domain Fusion Model for Through-Wall Human Activity Recognition Using IR-UWB Radar

被引:1
作者
Huang, Ling [1 ]
Lei, Dong [1 ]
Zheng, Bowen [1 ]
Chen, Guiping [1 ]
An, Huifeng [1 ]
Li, Mingxuan [1 ]
机构
[1] Lanzhou Univ Technol, Sch Elect Engn & Informat Engn, Lanzhou 730050, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 20期
基金
中国国家自然科学基金;
关键词
UWB radar; human activity recognition; time-frequency analysis; lightweight model; feature fusion; attention mechanism;
D O I
10.3390/app14209522
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Impulse radio ultra-wideband (IR-UWB) radar, operating in the low-frequency band, can penetrate walls and utilize its high range resolution to recognize different human activities. Complex deep neural networks have demonstrated significant performance advantages in classifying radar spectrograms of various actions, but at the cost of a substantial computational overhead. In response, this paper proposes a lightweight model named TG2-CAFNet. First, clutter suppression and time-frequency analysis are used to obtain range-time and micro-Doppler feature maps of human activities. Then, leveraging GhostV2 convolution, a lightweight feature extraction module, TG2, suitable for radar spectrograms is constructed. Using a parallel structure, the features of the two spectrograms are extracted separately. Finally, to further explore the correlation between the two spectrograms and enhance the feature representation capabilities, an improved nonlinear fusion method called coordinate attention fusion (CAF) is proposed based on attention feature fusion (AFF). This method extends the adaptive weighting fusion of AFF to a spatial distribution, effectively capturing the subtle spatial relationships between the two radar spectrograms. Experiments showed that the proposed method achieved a high degree of model lightweightness, while also achieving a recognition accuracy of 99.1%.
引用
收藏
页数:22
相关论文
共 30 条
  • [1] RPCA-Based High Resolution Through-the-Wall Human Motion Feature Extraction and Classification
    An, Qiang
    Wang, Shuoguang
    Yao, Lei
    Zhang, Wenji
    Lv, Hao
    Wang, Jianqi
    Li, Shiyong
    Hoorfar, Ahmad
    [J]. IEEE SENSORS JOURNAL, 2021, 21 (17) : 19058 - 19068
  • [2] Micro-Doppler-Based Human Activity Classification Using the Mote-Scale BumbleBee Radar
    Cagliyan, Bahri
    Gurbuz, Sevgi Zubeyde
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2015, 12 (10) : 2135 - 2139
  • [3] Human Activity Recognition Method Based on FMCW Radar Sensor with Multi-Domain Feature Attention Fusion Network
    Cao, Lin
    Liang, Song
    Zhao, Zongmin
    Wang, Dongfeng
    Fu, Chong
    Du, Kangning
    [J]. SENSORS, 2023, 23 (11)
  • [4] DIAT-RadHARNet: A Lightweight DCNN for Radar Based Classification of Human Suspicious Activities
    Chakraborty, Mainak
    Kumawat, Harish C.
    Dhavale, Sunita Vikrant
    Raj, Arockia Bazil A.
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [5] Cheraghinia M, 2024, Arxiv, DOI arXiv:2402.05649
  • [6] Attentional Feature Fusion
    Dai, Yimian
    Gieseke, Fabian
    Oehmcke, Stefan
    Wu, Yiquan
    Barnard, Kobus
    [J]. 2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 3559 - 3568
  • [7] Non-Contact Human Motion Recognition Based on UWB Radar
    Ding, Chuanwei
    Zhang, Li
    Gu, Chen
    Bai, Lei
    Liao, Zhicheng
    Hong, Hong
    Li, Yusheng
    Zhu, Xiaohua
    [J]. IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2018, 8 (02) : 306 - 315
  • [8] Segmented convolutional gated recurrent neural networks for human activity recognition in ultra-wideband radar
    Du, Hao
    Jin, Tian
    He, Yuan
    Song, Yongping
    Dai, Yongpeng
    [J]. NEUROCOMPUTING, 2020, 396 (396) : 451 - 464
  • [9] GhostNet: More Features from Cheap Operations
    Han, Kai
    Wang, Yunhe
    Tian, Qi
    Guo, Jianyuan
    Xu, Chunjing
    Xu, Chang
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 1577 - 1586
  • [10] He M., 2022, J. Radars, V12, P343