A Deep Machine Learning Method for Concurrent and Interleaved Human Activity Recognition

被引:22
作者
Thapa, Keshav [1 ]
Abdullah Al, Zubaer Md. [1 ]
Lamichhane, Barsha [1 ]
Yang, Sung-Hyun [1 ]
机构
[1] Kwangwoon Univ, Dept Elect Engn, Seoul 139701, South Korea
关键词
concurrent; interleaved; RNN; BiLSTM; SCCRF; activity recognition; Smart Home;
D O I
10.3390/s20205770
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Human activity recognition has become an important research topic within the field of pervasive computing, ambient assistive living (AAL), robotics, health-care monitoring, and many more. Techniques for recognizing simple and single activities are typical for now, but recognizing complex activities such as concurrent and interleaving activity is still a major challenging issue. In this paper, we propose a two-phase hybrid deep machine learning approach using bi-directional Long-Short Term Memory (BiLSTM) and Skip-Chain Conditional random field (SCCRF) to recognize the complex activity. BiLSTM is a sequential generative deep learning inherited from Recurrent Neural Network (RNN). SCCRFs is a distinctive feature of conditional random field (CRF) that can represent long term dependencies. In the first phase of the proposed approach, we recognized the concurrent activities using the BiLSTM technique, and in the second phase, SCCRF identifies the interleaved activity. Accuracy of the proposed framework against the counterpart state-of-art methods using the publicly available datasets in a smart home environment is analyzed. Our experiment's result surpasses the previously proposed approaches with an average accuracy of more than 93%.
引用
收藏
页码:1 / 20
页数:20
相关论文
共 41 条
[1]  
[Anonymous], **NON-TRADITIONAL**
[2]   3D-CNN-Based Fused Feature Maps with LSTM Applied to Action Recognition [J].
Arif, Sheeraz ;
Wang, Jing ;
Ul Hassan, Tehseen ;
Fei, Zesong .
FUTURE INTERNET, 2019, 11 (02)
[3]   Activity recognition from user-annotated acceleration data [J].
Bao, L ;
Intille, SS .
PERVASIVE COMPUTING, PROCEEDINGS, 2004, 3001 :1-17
[4]  
Bevilacqua A., 2018, Lecture Notes in Computer Science,, V1053
[5]  
Donahue J., 2015, P COMP VIS PATT REC
[6]  
Fiorini L., 2016, ITAL FORUM AMBIENT A, V426, P251
[7]  
GALLEY M, 2006, P 2006 C EMP METH NA, P364
[8]  
Graves A, 2013, 2013 IEEE WORKSHOP ON AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING (ASRU), P273, DOI 10.1109/ASRU.2013.6707742
[9]   LSTM: A Search Space Odyssey [J].
Greff, Klaus ;
Srivastava, Rupesh K. ;
Koutnik, Jan ;
Steunebrink, Bas R. ;
Schmidhuber, Juergen .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (10) :2222-2232
[10]   A study of a method for distribution analysis of skin color [J].
Ha, Seunghan ;
Lee, Minhee ;
Lee, Onseok ;
Lee, Gunwoo ;
Kim, Jeayoung ;
Moon, Jongsub ;
Kim, Mingi ;
Oh, Chilhwan .
SKIN RESEARCH AND TECHNOLOGY, 2009, 15 (02) :200-213