Gait Recognition in Different Terrains with IMUs Based on Attention Mechanism Feature Fusion Method

被引:0
作者
Mengxue Yan
Ming Guo
Jianqiang Sun
Jianlong Qiu
Xiangyong Chen
机构
[1] Linyi University,School of Automation and Electrical Engineering
来源
Neural Processing Letters | 2023年 / 55卷
关键词
Gait recognition; Inertial measurement unit; Lightweight convolutional neural network; Attention mechanism; Feature fusion;
D O I
暂无
中图分类号
学科分类号
摘要
Gait recognition is significant in the fields of disease diagnosis and rehabilitation training by studying the characteristics of human gait with different terrain. To address the problem that the transformation of different outdoor terrains can affect the gait of walkers, a gait recognition algorithm based on feature fusion with attention mechanism is proposed. First, the acceleration, angular velocity and angle information collected by the inertial measurement unit is used; then the acquired inertial gait data is divided into periods to obtain the period data of each step; then the features are extracted from the data, followed by the visualization of the one-dimensional data into two-dimensional images. A lightweight model is designed to combine convolutional neural network with attention mechanism, and a new attention mechanism-based feature fusion method is proposed in this paper for extracting features from multiple sensors and fusing them for gait recognition. The comparison experimental results show that the recognition accuracy of the model proposed in this paper can reach 89%\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\%$$\end{document}, and it has good recognition effect on gait under different terrain.
引用
收藏
页码:10215 / 10234
页数:19
相关论文
共 140 条
[1]  
Sahu G(2020)A contemporary survey on human gait recognition J Inf Assur Secur 15 94-106
[2]  
Parida P(2019)3-D canonical pose estimation and abnormal gait recognition with a single RGB-D camera IEEE Robot Autom Lett 4 3617-3624
[3]  
Guo Y(2018)Gait recognition in the wild using shadow silhouettes Image Vis Comput 76 1-13
[4]  
Deligianni F(2018)Multimodal face-pose estimation with multitask manifold deep learning IEEE Trans Ind Inf 15 3952-3961
[5]  
Gu X(2015)Multimodal deep autoencoder for human pose recovery. IEEE Trans Image Process 24 5659-5670
[6]  
Yang GZ(2019)EEG-based volitional control of prosthetic legs for walking in different terrains IEEE Trans Autom Sci Eng 18 530-540
[7]  
Verlekar TT(2022)Multi-scale learning for multimodal neurophysiological signals: gait pattern classification as an example Neural Process Lett 54 2455-2470
[8]  
Soares LD(2019)Human gait recognition system based on support vector machine algorithm and using wearable sensors Sens Mater 31 1335-1349
[9]  
Correia PL(2013)Automated detection of instantaneous gait events using time frequency analysis and manifold embedding IEEE Trans Neural Syst Rehabil Eng 21 908-916
[10]  
Hong C(2023)Convolutional neural network and sensor fusion for obstacle classification in the context of powered prosthetic leg applications Comput Electr Eng 108 9891-4480