Self-Attention Networks For Motion Posture Recognition Based On Data Fusion

被引:2
作者
Ji, Zhihao [1 ]
Xie, Qiang [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Nanjing, Jiangsu, Peoples R China
来源
4TH INTERNATIONAL CONFERENCE ON INFORMATICS ENGINEERING AND INFORMATION SCIENCE (ICIEIS2021) | 2022年 / 12161卷
关键词
Motion posture recognition; Data fusion; Kalman filter; CNN; LSTM; Self-Attention;
D O I
10.1117/12.2626923
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Aiming at the problems of error and poor recognition effect in the data collected by sensors in current motion posture recognition, this paper proposes a self-attention network for motion posture recognition based on data fusion to solve these problems. This method uses the attitude angle information output by the gyroscope to correct the attitude angle obtained by the acceleration sensor using kalman filtering, which effectively improves the accuracy of the attitude angle; at the same time, the attitude angle and acceleration sensor data are used to construct an attention convolutional neural long short term memory artificial neural network (CNN-LSTM) of the attention mechanism to recognize the motion state. The experimental results show that the use of data fusion method can correspond to the accuracy of physical signs, and compared with the traditional network, the accuracy of the network frame recognition proposed in this paper is improved.
引用
收藏
页数:8
相关论文
共 9 条
[1]   A robust human activity recognition system using smartphone sensors and deep learning [J].
Hassan, Mohammed Mehedi ;
Uddin, Md. Zia ;
Mohamed, Amr ;
Almogren, Ahmad .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 81 :307-313
[2]  
Jang Jinhwan, TRANSPORTATION RES I, V11
[3]   Description of a database containing wrist PPG signals recorded during physical exercise with both accelerometer and gyroscope measures of motion [J].
Jarchi, Delaram ;
Casson, Alexander J. .
Data, 2017, 2 (01)
[4]  
Lee SM, 2017, INT CONF BIG DATA, P131, DOI 10.1109/BIGCOMP.2017.7881728
[5]  
Lin Z., 2017, Computat. Lang, V1, P1703, DOI [DOI 10.48550/ARXIV.1703.03130, 10.48550/arXiv.1703.03130]
[6]  
Mahmud T, 2020, MIDWEST SYMP CIRCUIT, P249, DOI [10.1109/mwscas48704.2020.9184666, 10.1109/MWSCAS48704.2020.9184666]
[7]  
Mutegeki Ronald, 2020, 2020 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), P362, DOI 10.1109/ICAIIC48513.2020.9065078
[8]   A Review on Human Activity Recognition Using Vision-Based Method [J].
Zhang, Shugang ;
Wei, Zhiqiang ;
Nie, Jie ;
Huang, Lei ;
Wang, Shuang ;
Li, Zhen .
JOURNAL OF HEALTHCARE ENGINEERING, 2017, 2017
[9]   A Novel Wireless Mobile Platform to Locate and Gather Data From Optical Fiber Sensors Integrated Into a WSN [J].
Zhou, Bochao ;
Yang, Shuo ;
Sun, Tong ;
Grattan, Kenneth T. V. .
IEEE SENSORS JOURNAL, 2015, 15 (06) :3615-3621