IndRNN Based Long-term Temporal Recognition in the Spatial an Frequency Domain

被引:15
作者
Zhao, Beidi [1 ]
Li, Shuai [2 ]
Gao, Yanbo [2 ]
机构
[1] Univ Elect Sci & Technol China, Chengdu, Peoples R China
[2] Shandong Univ, Jinan, Peoples R China
来源
UBICOMP/ISWC '20 ADJUNCT: PROCEEDINGS OF THE 2020 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2020 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS | 2020年
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Activity recognition; IndRNN; SHL dataset; Smartphone;
D O I
10.1145/3410530.3414355
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
This paper targets the SI IL recognition challenge, which focuses on the location-independent and user-independent activity recognition using smartphone sensors. To address this long-range temporal problem with periodic nature, we propose a new approach (team IndRNN), an Independently Recurrent Neural Network (IndRNN) based long-term temporal activity recognition with spatial and frequency domain features. The data is first segmented into one second sliding windows, then temporal and frequency domain features are extracted as short-term temporal features. A deep IndRNN model is used to predict the unknown test dataset location. Under the predicted location, a deep IndRNN model is further used to classify the 8 activities with best performed features. Finally, transfer learning and model fusion are used to improve the result under the user-independence case. The proposed method achieves 86.94% accuracy on the validation set at the predicted location.
引用
收藏
页码:368 / 372
页数:5
相关论文
共 15 条
[1]   EmbraceNet for Activity: A Deep Multimodal Fusion Architecture for Activity Recognition [J].
Choi, Jun-Ho ;
Lee, Jong-Seok .
UBICOMP/ISWC'19 ADJUNCT: PROCEEDINGS OF THE 2019 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2019 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, 2019, :693-698
[2]   The University of Sussex-Huawei Locomotion and Transportation Dataset for Multimodal Analytics With Mobile Devices [J].
Gjoreski, Hristijan ;
Ciliberto, Mathias ;
Wang, Lin ;
Morales, Francisco Javier Ordonez ;
Mekki, Sami ;
Valentin, Stefan ;
Roggen, Daniel .
IEEE ACCESS, 2018, 6 :42592-42604
[3]   Applying Multiple Knowledge to Sussex-Huawei Locomotion Challenge [J].
Gjoreski, Martin ;
Janko, Vito ;
Rescic, Nina ;
Mlakar, Miha ;
Lustrek, Mitja ;
Bizjak, Jani ;
Slapnicar, Gasper ;
Marinko, Matej ;
Drobnic, Vid ;
Gams, Matjaz .
PROCEEDINGS OF THE 2018 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2018 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS (UBICOMP/ISWC'18 ADJUNCT), 2018, :1488-1496
[4]   Cross-Location Transfer Learning for The Sussex-Huawei Locomotion Recognition Challenge [J].
Janko, Vito ;
Gjoreski, Martin ;
De Masi, Carlo Maria ;
Rescic, Nina ;
Lustrek, Mitja ;
Gams, Matjaz .
UBICOMP/ISWC'19 ADJUNCT: PROCEEDINGS OF THE 2019 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2019 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, 2019, :730-735
[5]   Fast Spatio-Temporal Residual Network for Video Super-Resolution [J].
Li, Sheng ;
He, Fengxiang ;
Du, Bo ;
Zhang, Lefei ;
Xu, Yonghao ;
Tao, Dacheng .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :10514-10523
[6]   A fully trainable network with RNN-based pooling [J].
Li, Shuai ;
Li, Wanqing ;
Cook, Chris ;
Zhu, Ce ;
Gao, Yanbo .
NEUROCOMPUTING, 2019, 338 :72-82
[7]   Independently Recurrent Neural Network (IndRNN): Building A Longer and Deeper RNN [J].
Li, Shuai ;
Li, Wanqing ;
Cook, Chris ;
Zhu, Ce ;
Gao, Yanbo .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :5457-5466
[8]  
Wang L., 2020, P 2020 ACM INT JOINT
[9]   Summary of the Sussex-Huawei Locomotion-Transportation Recognition Challenge 2019 [J].
Wang, Lin ;
Gjoreski, Hristijan ;
Ciliberto, Mathias ;
Lago, Paula ;
Murao, Kazuya ;
Okita, Tsuyoshi ;
Roggen, Daniel .
UBICOMP/ISWC'19 ADJUNCT: PROCEEDINGS OF THE 2019 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2019 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, 2019, :849-856
[10]   Summary of the Sussex-Huawei Locomotion-Transportation Recognition Challenge [J].
Wang, Lin ;
Gjoreski, Hristijan ;
Murao, Kazuya ;
Okita, Tsuyoshi ;
Roggen, Daniel .
PROCEEDINGS OF THE 2018 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2018 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS (UBICOMP/ISWC'18 ADJUNCT), 2018, :1521-1530