Binarized Neural Network for Edge Intelligence of Sensor-Based Human Activity Recognition

被引:43
作者
Luo, Fei [1 ]
Khan, Salabat [1 ]
Huang, Yandao [1 ]
Wu, Kaishun [1 ]
机构
[1] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
关键词
Sensors; Intelligent sensors; Activity recognition; Neural networks; Cloud computing; Wearable sensors; Real-time systems; Human activity recognition; binarized neural network; edge computing; edge intelligence; radar sensors; wearable sensors;
D O I
10.1109/TMC.2021.3109940
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A wide diversity of sensors has been applied in human activity recognition. These sensors generate enormous amounts of data during human activity monitoring. Server-based computing and cloud computing require to upload all sensor data to servers/clouds for data processing and analysis. The long-distance data traveling between sensors and servers increases the costs of bandwidth and latency. However, human activity recognition has a high demand for real-time processing. Recently, edge computing is surging to solve this problem by moving computation and data storage closer to the sensors, rather than relying on a central server/cloud. Most human activity recognition is conducted by artificial intelligence, which requires intensive computation and high power consumption. Edge servers are usually designed for low power, low cost, and low computation. They do not support computation-intensive deep learning algorithms or result in high latency. Fortunately, the development of binarized neural networks enables edge intelligence, which supports AI running at the network edge for real-time applications. In this paper, we implement a binarized neural network (BinaryDilatedDenseNet) to enable low-latency and low-memory human activity recognition at the network edge. We applied the BinaryDilatedDenseNet on three sensor-based human activity recognition datasets and evaluated it with four metrics. In comparison, the BinaryDilatedDenseNet outperforms the related work and other three binarized neural networks in overall and saves 10x memory and 4.5x-8x inference time compared to the FPDilatedDenseNet(the full-precision version of the BinaryDilatedDenseNet).
引用
收藏
页码:1356 / 1368
页数:13
相关论文
共 64 条
[31]  
Kudrle S., 2010, PROC SMPTE ANN TECH, P1
[32]   A Survey on Human Activity Recognition using Wearable Sensors [J].
Lara, Oscar D. ;
Labrador, Miguel A. .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2013, 15 (03) :1192-1209
[33]   Performance Guaranteed Network Acceleration via High-Order Residual Quantization [J].
Li, Zefan ;
Ni, Bingbing ;
Zhang, Wenjun ;
Yang, Xiaokang ;
Gao, Wen .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2603-2611
[34]   Bi-Real Net: Enhancing the Performance of 1-Bit CNNs with Improved Representational Capability and Advanced Training Algorithm [J].
Liu, Zechun ;
Wu, Baoyuan ;
Luo, Wenhan ;
Yang, Xin ;
Liu, Wei ;
Cheng, Kwang-Ting .
COMPUTER VISION - ECCV 2018, PT 15, 2018, 11219 :747-763
[35]   Temporal Transformer Networks: Joint Learning of Invariant and Discriminative Time Warping [J].
Lohit, Suhas ;
Wang, Qiao ;
Turaga, Pavan .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :12418-12427
[36]   Asymmetric Residual Neural Network for Accurate Human Activity Recognition [J].
Long, Jun ;
Sun, Wuqing ;
Yang, Zhan ;
Raymond, Osolo Ian .
INFORMATION, 2019, 10 (06)
[37]  
Lueth K., 2019, State of the IoT 2018: Number of IoT Devices Now at 7BMarket Accelerating
[38]   Temporal Convolutional Networks for Multiperson Activity Recognition Using a 2-D LIDAR [J].
Luo, Fei ;
Poslad, Stefan ;
Bodanese, Eliane .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (08) :7432-7442
[39]  
Luo F, 2019, IEEE ICC, DOI 10.1109/icc.2019.8761484
[40]   Human Activity Detection and Coarse Localization Outdoors Using Micro-Doppler Signatures [J].
Luo, Fei ;
Poslad, Stefan ;
Bodanese, Eliane .
IEEE SENSORS JOURNAL, 2019, 19 (18) :8079-8094