HHI-AttentionNet: An Enhanced Human-Human Interaction Recognition Method Based on a Lightweight Deep Learning Model with Attention Network from CSI

被引:8
|
作者
Shafiqul, Islam Md [1 ]
Jannat, Mir Kanon Ara [1 ]
Kim, Jin-Woo [1 ]
Lee, Soo-Wook [2 ]
Yang, Sung-Hyun [1 ]
机构
[1] Kwangwoon Univ, Dept Elect Engn, Seoul 01897, South Korea
[2] Kwangwoon Univ, Kwangwoon Acad, Seoul 01897, South Korea
关键词
human activity recognition (HAR); human-human interactions (HHIs); channel state information (CSI); deep learning (DL); antenna-frame-subcarrier attention mechanism (AFSAM);
D O I
10.3390/s22166018
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Nowadays WiFi based human activity recognition (WiFi-HAR) has gained much attraction in an indoor environment due to its various benefits, including privacy and security, device free sensing, and cost-effectiveness. Recognition of human-human interactions (HHIs) using channel state information (CSI) signals is still challenging. Although some deep learning (DL) based architectures have been proposed in this regard, most of them suffer from limited recognition accuracy and are unable to support low computation resource devices due to having a large number of model parameters. To address these issues, we propose a dynamic method using a lightweight DL model (HHI-AttentionNet) to automatically recognize HHIs, which significantly reduces the parameters with increased recognition accuracy. In addition, we present an Antenna-Frame-Subcarrier Attention Mechanism (AFSAM) in our model that enhances the representational capability to recognize HHIs correctly. As a result, the HHI-AttentionNet model focuses on the most significant features, ignoring the irrelevant features, and reduces the impact of the complexity on the CSI signal. We evaluated the performance of the proposed HHI-AttentionNet model on a publicly available CSI-based HHI dataset collected from 40 individual pairs of subjects who performed 13 different HHIs. Its performance is also compared with other existing methods. These proved that the HHI-AttentionNet is the best model providing an average accuracy, F1 score, Cohen's Kappa, and Matthews correlation coefficient of 95.47%, 95.45%, 0.951%, and 0.950%, respectively, for recognition of 13 HHIs. It outperforms the best existing model's accuracy by more than 4%.
引用
收藏
页数:19
相关论文
共 18 条
  • [1] CSI-IANet: An Inception Attention Network for Human-Human Interaction Recognition Based on CSI Signal
    Kabir, M. Humayun
    Rahman, M. Hafizur
    Shin, Wonjae
    IEEE ACCESS, 2021, 9 : 166624 - 166638
  • [2] Deep Convolution Neural Network Based CSI Signal Classifier to Recognize Human-Human Interactions
    Kabir, M. Humayun
    Shin, Wonjae
    2021 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS-ASIA (ICCE-ASIA), 2021,
  • [3] A Deep Learning Based Lightweight Human Activity Recognition System Using Reconstructed WiFi CSI
    Chen, Xingcan
    Zou, Yi
    Li, Chenglin
    Xiao, Wendong
    IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2024, 54 (01) : 68 - 78
  • [4] CSI-Based Human Activity Recognition via Lightweight CNN Model and Data Augmentation
    El Zein, Hadi
    Mourad-Chehade, Farah
    Amoud, Hassan
    IEEE SENSORS JOURNAL, 2024, 24 (15) : 25060 - 25069
  • [5] Radar Human Activity Recognition with an Attention-Based Deep Learning Network
    Huan, Sha
    Wu, Limei
    Zhang, Man
    Wang, Zhaoyue
    Yang, Chao
    SENSORS, 2023, 23 (06)
  • [6] WiLDAR: WiFi Signal-Based Lightweight Deep Learning Model for Human Activity Recognition
    Deng, Fuxiang
    Jovanov, Emil
    Song, Houbing
    Shi, Weisong
    Zhang, Yuan
    Xu, Wenyao
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (02) : 2899 - 2908
  • [7] Environment-Robust WiFi-Based Human Activity Recognition Using Enhanced CSI and Deep Learning
    Shi, Zhenguo
    Cheng, Qingqing
    Zhang, J. Andrew
    Xu, Richard Yi Da
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (24) : 24643 - 24654
  • [8] A Lightweight Deep Learning Model for Human Activity Recognition on Edge Devices
    Agarwal, Preeti
    Alam, Mansaf
    INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND DATA SCIENCE, 2020, 167 : 2364 - 2373
  • [9] Lightweight Deep Learning Model in Mobile-Edge Computing for Radar-Based Human Activity Recognition
    Zhu, Jianping
    Lou, Xin
    Ye, Wenbin
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (15) : 12350 - 12359
  • [10] STC-NLSTMNet: An Improved Human Activity Recognition Method Using Convolutional Neural Network with NLSTM from WiFi CSI
    Islam, Md Shafiqul
    Jannat, Mir Kanon Ara
    Hossain, Mohammad Nahid
    Kim, Woo-Su
    Lee, Soo-Wook
    Yang, Sung-Hyun
    SENSORS, 2023, 23 (01)