Using Latent Knowledge to Improve Real-Time Activity Recognition for Smart IoT

被引:15
|
作者
Yan, Surong [1 ]
Lin, Kwei-Jay [2 ]
Zheng, Xiaolin [3 ]
Zhang, Wenyu [1 ]
机构
[1] Zhejiang Univ Finance & Econ, Hangzhou 310012, Zhejiang, Peoples R China
[2] Univ Calif Irvine, Dept Elect Engn & Comp Sci, Irvine, CA 92697 USA
[3] Zhejiang Univ, Hangzhou 310027, Zhejiang, Peoples R China
关键词
Hidden Markov models; Probability distribution; Real-time systems; Windows; Deep learning; Microsoft Windows; Activity recognition; streaming data; latent knowledge; activity prediction; unsupervised learning;
D O I
10.1109/TKDE.2019.2891659
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Real-time/online activity recognition (AR) is an important technology in smart Internet of Things (IoT) systems where users are assisted by smart devices in their daily activities. How to generate appropriate feature representation from sensor event streaming is a challenging issue for accurate and efficient real-time AR. Previous AR models that rely on explicit domain knowledge are not appropriate for online recognition of complex human activities. We propose to use unsupervised learning to learn about the latent knowledge and embed the activity probability distribution prediction as high-level features to boost real-time AR performance. The proposed approach first learns the latent knowledge from explicit-activity window sequences using unsupervised learning, and derives the probability distribution prediction of activity classes for a given sliding window. Our approach then feeds the prediction with other basic features of the sliding window into a classifier to produce the final class result on each event-count sliding window. Experiments on five smart home datasets show that the proposed method achieves a higher accuracy by at least 20 percent improvement on F1_score than previous traditional algorithms, while maintaining a lower time cost than deep learning based methods. An analysis on the feature importance shows that the addition of probability distribution prediction about activity classes leads to a promising direction for real-time AR.
引用
收藏
页码:574 / 587
页数:14
相关论文
共 50 条
  • [1] A Smart Wireless IoT Ring for Real-Time Keystroke Recognition Using Edge Computing
    Zhao, Yuliang
    Ren, Xianshou
    Lian, Chao
    Ma, Ruijie
    Zhang, Xueliang
    Sha, Xiaopeng
    Li, Wen Jung
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
  • [2] Real-Time Activity Recognition and Assistance in Smart Classrooms
    Efthymiou, Vasileios
    Koutraki, Maria
    Antoniou, Grigoris
    ADCAIJ-ADVANCES IN DISTRIBUTED COMPUTING AND ARTIFICIAL INTELLIGENCE JOURNAL, 2012, 1 (01): : 10 - 23
  • [3] A smart camera for real-time human activity recognition
    Wolf, W
    Ozer, IB
    SIPS 2001: IEEE WORKSHOP ON SIGNAL PROCESSING SYSTEMS: DESIGN AND IMPLEMENTATION, 2001, : 217 - 224
  • [4] User-Centric and Real-Time Activity Recognition Using Smart Glasses
    Ho, Joshua
    Wang, Chien-Min
    GREEN, PERVASIVE, AND CLOUD COMPUTING, 2016, 9663 : 196 - 210
  • [5] Real-Time Image Recognition Using Collaborative IoT Devices
    Hadidi, Ramyad
    Cao, Jiashen
    Woodward, Matthew
    Ryoo, Michael S.
    Kim, Hyesoon
    1ST ACM REQUEST WORKSHOP/TOURNAMENT ON REPRODUCIBLE SOFTWARE/HARDWARE CO-DESIGN OF PARETO-EFFICIENT DEEP LEARNING, 2018,
  • [6] A Real-time Cardiac Monitoring using a Multisensory Smart IoT System
    Majumder, A. K. M. Jahangir Alam
    ElSaadany, Mohammed
    Izaguirre, Joshua Aaron
    Ucci, Donald R.
    2019 IEEE 43RD ANNUAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE (COMPSAC), VOL 2, 2019, : 281 - 287
  • [7] Real-Time Physical Activity Recognition on Smart Mobile Devices Using Convolutional Neural Networks
    Peppas, Konstantinos
    Tsolakis, Apostolos C.
    Krinidis, Stelios
    Tzovaras, Dimitrios
    APPLIED SCIENCES-BASEL, 2020, 10 (23): : 1 - 25
  • [8] Real-time recognition of activity using temporal templates
    Bobick, A
    Davis, J
    THIRD IEEE WORKSHOP ON APPLICATIONS OF COMPUTER VISION - WACV '96, PROCEEDINGS, 1996, : 39 - 42
  • [9] Smart Real-Time PV Surveillance Network with IOT
    Maniraj, P.
    Lathika, A.
    Ravina, C. M.
    Pradeebha, E.
    Suresh, M.
    Sundar, S.
    INTERNATIONAL CONFERENCE ON MECHATRONICS IN ENERGY AND ENVIRONMENT PROTECTION (ICMEEP 2020), 2020, 995
  • [10] A Real-Time Smart Wastewater Monitoring System Using IoT: Perspective of Bangladesh
    Hasan, Muhammed Sakib
    Khandaker, Shahjalal
    Iqbal, Md Shahid
    Kabir, Md Monirul
    2020 2ND INTERNATIONAL CONFERENCE ON SUSTAINABLE TECHNOLOGIES FOR INDUSTRY 4.0 (STI), 2020,