Shallow Convolutional Neural Networks for Human Activity Recognition Using Wearable Sensors

被引:91
作者
Huang, Wenbo [1 ]
Zhang, Lei [1 ]
Gao, Wenbin [1 ]
Min, Fuhong [1 ]
He, Jun [2 ]
机构
[1] Nanjing Normal Univ, Sch Elect & Automat Engn, Nanjing 210023, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Sch Elect & Informat Engn, Nanjing 210044, Peoples R China
基金
美国国家科学基金会;
关键词
Convolutional neural networks (CNNs); cross-channel communication; deep learning; human activity recognition (HAR); sensor;
D O I
10.1109/TIM.2021.3091990
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Due to rapid development of sensor technology, human activity recognition (HAR) using wearable inertial sensors has recently become a new research hotspot. Deep learning, especially convolutional neural network (CNN) that can automatically learn intricate activity features have gained a lot of attention in ubiquitous HAR task. Most existing CNNs process sensor input by extracting channel-wise features, and the information from each channel can be separately propagated in a hierarchical way from lower layers to higher layers. As a result, they typically overlook information exchange among channels within the same layer. In this article, we first propose a shallow CNN that considers cross-channel communication in HAR scenario, where all channels in the same layer have a comprehensive interaction to capture more discriminative features of sensor input. One channel can communicate with all other channels by graph neural network to remove redundant information accumulated among channels, which is more beneficial for deploying lightweight deep models. Extensive experiments are conducted on multiple benchmark HAR datasets, namely UCI-HAR, OPPORTUNITY, PAMAP2 and UniMib-SHAR, which indicates that the proposed method enables shallower CNNs to aggregate more useful information, and surpasses baseline deep networks and other competitive methods. The inference speed is evaluated via deploying the HAR systems on an embedded system.
引用
收藏
页数:11
相关论文
共 42 条
[1]  
Anguita D., 2012, P INT WORKSH AMB ASS, P216, DOI 10.1007 /978-3-642-35395-6 30
[2]   A Tutorial on Human Activity Recognition Using Body-Worn Inertial Sensors [J].
Bulling, Andreas ;
Blanke, Ulf ;
Schiele, Bernt .
ACM COMPUTING SURVEYS, 2014, 46 (03)
[3]   SCA-CNN: Spatial and Channel-wise Attention in Convolutional Networks for Image Captioning [J].
Chen, Long ;
Zhang, Hanwang ;
Xiao, Jun ;
Nie, Liqiang ;
Shao, Jian ;
Liu, Wei ;
Chua, Tat-Seng .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6298-6306
[4]   Smartphone Sensor-Based Human Activity Recognition Using Feature Fusion and Maximum Full a Posteriori [J].
Chen, Zhenghua ;
Jiang, Chaoyang ;
Xiang, Shili ;
Ding, Jie ;
Wu, Min ;
Li, Xiaoli .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (07) :3992-4001
[5]   Deformable Convolutional Networks [J].
Dai, Jifeng ;
Qi, Haozhi ;
Xiong, Yuwen ;
Li, Yi ;
Zhang, Guodong ;
Hu, Han ;
Wei, Yichen .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :764-773
[6]  
Gao X., 2018, ARXIV PREPRINT ARXIV
[7]   Path Planning of Coastal Ships Based on Optimized DQN Reward Function [J].
Guo, Siyu ;
Zhang, Xiuguo ;
Du, Yiquan ;
Zheng, Yisong ;
Cao, Zhiying .
JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2021, 9 (02) :1-23
[8]  
Han S., 2016, P INT C LEARN REPR I
[9]   Channel Pruning for Accelerating Very Deep Neural Networks [J].
He, Yihui ;
Zhang, Xiangyu ;
Sun, Jian .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :1398-1406
[10]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/TPAMI.2019.2913372, 10.1109/CVPR.2018.00745]