CSITime: Privacy-preserving human activity recognition using WiFi channel state information

被引:47
作者
Yadav, Santosh Kumar [1 ,2 ,3 ]
Sai, Siva [4 ]
Gundewar, Akshay [4 ]
Rathore, Heena [5 ]
Tiwari, Kamlesh [4 ]
Pandey, Hari Mohan [6 ]
Mathur, Mohit [3 ]
机构
[1] Acad Sci & Innovat Res AcSIR, Ghaziabad 201002, UP, India
[2] CSIR Cent Elect Engn Res Inst CEERI, Cyber Phys Syst, Pilani 333031, Rajasthan, India
[3] DeepBlink LLC, 30 N Gould St Ste R, Sheridan, WY 82801 USA
[4] Birla Inst Technol & Sci Pilani, Dept CSIS, Pilani Campus, Pilani 333031, Rajasthan, India
[5] Univ Texas San Antonio, Dept Comp Sci, San Antonio, TX USA
[6] Edge Hill Univ, Dept Comp Sci, Ormskirk, Lancs, England
关键词
Human activity recognition; WiFi channel state information; Time series classification; Data augmentation;
D O I
10.1016/j.neunet.2021.11.011
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human activity recognition (HAR) is an important task in many applications such as smart homes, sports analysis, healthcare services, etc. Popular modalities for human activity recognition involving computer vision and inertial sensors are in the literature for solving HAR, however, they face serious limitations with respect to different illumination, background, clutter, obtrusiveness, and other factors. In recent years, WiFi channel state information (CSI) based activity recognition is gaining momentum due to its many advantages including easy deployability, and cost-effectiveness. This work proposes CSITime, a modified InceptionTime network architecture, a generic architecture for CSI-based human activity recognition. We perceive CSI activity recognition as a multi-variate time series problem. The methodology of CSITime is threefold. First, we pre-process CSI signals followed by data augmentation using two label-mixing strategies - mixup and cutmix to enhance the neural network's learning. Second, in the basic block of CSITime, features from multiple convolutional kernels are concatenated and passed through a self-attention layer followed by a fully connected layer with Mish activation. CSITime network consists of six such blocks followed by a global average pooling layer and a final fully connected layer for the final classification. Third, in the training of the neural network, instead of adopting general training procedures such as early stopping, we use one-cycle policy and cosine annealing to monitor the learning rate. The proposed model has been tested on publicly available benchmark datasets, i.e., ARIL, StanWiFi, and SignFi datasets. The proposed CSITime has achieved accuracy of 98.20%, 98%, and 95.42% on ARIL, StanWiFi, and SignFi datasets, respectively, for WiFi-based activity recognition. This is an improvement on state-of-the-art accuracies by 3.3%, 0.67%, and 0.82% on ARIL, StanWiFi, and SignFi datasets, respectively. In lab-5 users' scenario of the SignFi dataset, which has the training and testing data from different distributions, our model achieved accuracy was 2.17% higher than state-of-the-art, which shows the comparative robustness of our model. (C) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页码:11 / 21
页数:11
相关论文
共 55 条
  • [1] [Anonymous], 2010, 23 INT C ARCH COMP S
  • [2] Chen C, 2015, IEEE IMAGE PROC, P168, DOI 10.1109/ICIP.2015.7350781
  • [3] WiFi CSI Based Passive Human Activity Recognition Using Attention Based BLSTM
    Chen, Zhenghua
    Zhang, Le
    Jiang, Chaoyang
    Cao, Zhiguang
    Cui, Wei
    [J]. IEEE TRANSACTIONS ON MOBILE COMPUTING, 2019, 18 (11) : 2714 - 2724
  • [4] Chowdhury TZ, 2017, IEEE GLOB CONF SIG, P338, DOI 10.1109/GlobalSIP.2017.8308660
  • [5] Device Free Human Activity Recognition using WiFi Channel State Information
    Damodaran, Neena
    Schaefer, Joerg
    [J]. 2019 IEEE SMARTWORLD, UBIQUITOUS INTELLIGENCE & COMPUTING, ADVANCED & TRUSTED COMPUTING, SCALABLE COMPUTING & COMMUNICATIONS, CLOUD & BIG DATA COMPUTING, INTERNET OF PEOPLE AND SMART CITY INNOVATION (SMARTWORLD/SCALCOM/UIC/ATC/CBDCOM/IOP/SCI 2019), 2019, : 1069 - 1074
  • [6] Dempster A., 2021, P 27 ACM SIGKDD C KN, P248
  • [7] WiDriver: Driver Activity Recognition System Based on WiFi CSI
    Duan, Shihong
    Yu, Tianqing
    He, Jie
    [J]. INTERNATIONAL JOURNAL OF WIRELESS INFORMATION NETWORKS, 2018, 25 (02) : 146 - 156
  • [8] InceptionTime: Finding AlexNet for time series classification
    Fawaz, Hassan Ismail
    Lucas, Benjamin
    Forestier, Germain
    Pelletier, Charlotte
    Schmidt, Daniel F.
    Weber, Jonathan
    Webb, Geoffrey, I
    Idoumghar, Lhassane
    Muller, Pierre-Alain
    Petitjean, Francois
    [J]. DATA MINING AND KNOWLEDGE DISCOVERY, 2020, 34 (06) : 1936 - 1962
  • [9] HuAc: Human Activity Recognition Using Crowdsourced WiFi Signals and Skeleton Data
    Guo, Linlin
    Wang, Lei
    Liu, Jialin
    Zhou, Wei
    Lu, Bingxian
    [J]. WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2018,
  • [10] WiReader: Adaptive Air Handwriting Recognition Based on Commercial WiFi Signal
    Guo, Zhengxin
    Xiao, Fu
    Sheng, Biyun
    Fei, Huan
    Yu, Shui
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (10): : 10483 - 10494