Gait Recognition in Different Terrains with IMUs Based on Attention Mechanism Feature Fusion Method

被引:2
作者
Yan, Mengxue [1 ]
Guo, Ming [1 ]
Sun, Jianqiang [1 ]
Qiu, Jianlong [1 ]
Chen, Xiangyong [1 ]
机构
[1] Linyi Univ, Sch Automation & Elect Engn, Lanshan St, Linyi 276000, Shandong, Peoples R China
基金
中国国家自然科学基金;
关键词
Gait recognition; Inertial measurement unit; Lightweight convolutional neural network; Attention mechanism; Feature fusion; POSE ESTIMATION; ALGORITHM;
D O I
10.1007/s11063-023-11324-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Gait recognition is significant in the fields of disease diagnosis and rehabilitation training by studying the characteristics of human gait with different terrain. To address the problem that the transformation of different outdoor terrains can affect the gait of walkers, a gait recognition algorithm based on feature fusion with attention mechanism is proposed. First, the acceleration, angular velocity and angle information collected by the inertial measurement unit is used; then the acquired inertial gait data is divided into periods to obtain the period data of each step; then the features are extracted from the data, followed by the visualization of the one-dimensional data into two-dimensional images. A lightweight model is designed to combine convolutional neural network with attention mechanism, and a new attention mechanism-based feature fusion method is proposed in this paper for extracting features from multiple sensors and fusing them for gait recognition. The comparison experimental results show that the recognition accuracy of the model proposed in this paper can reach 89%, and it has good recognition effect on gait under different terrain.
引用
收藏
页码:10215 / 10234
页数:20
相关论文
共 45 条
[1]   Melanoma Lesion Detection and Segmentation Using YOLOv4-DarkNet and Active Contour [J].
Albahli, Saleh ;
Nida, Nudrat ;
Irtaza, Aun ;
Yousaf, Muhammad Haroon ;
Mahmood, Muhammad Tariq .
IEEE ACCESS, 2020, 8 :198403-198414
[2]   Automated Detection of Instantaneous Gait Events Using Time Frequency Analysis and Manifold Embedding [J].
Aung, Min S. H. ;
Thies, Sibylle B. ;
Kenney, Laurence P. J. ;
Howard, David ;
Selles, Ruud W. ;
Findlow, Andrew H. ;
Goulermas, John Y. .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2013, 21 (06) :908-916
[3]   User Authentication by Gait Data from Smartphone Sensors Using Hybrid Deep Learning Network [J].
Cao, Qian ;
Xu, Fei ;
Li, Huiyong .
MATHEMATICS, 2022, 10 (13)
[4]   Improving Inertial Sensor-Based Activity Recognition in Neurological Populations [J].
Celik, Yunus ;
Aslan, M. Fatih ;
Sabanci, Kadir ;
Stuart, Sam ;
Woo, Wai Lok ;
Godfrey, Alan .
SENSORS, 2022, 22 (24)
[5]   Flexible Piezoelectric Sensor-Based Gait Recognition [J].
Cha, Youngsu ;
Kim, Hojoon ;
Kim, Doik .
SENSORS, 2018, 18 (02)
[6]  
Choi S, 2014, INT CONF COMPUT NETW, P1091, DOI 10.1109/ICCNC.2014.6785491
[7]   Real-time walking gait terrain classification from foot-mounted Inertial Measurement Unit using Convolutional Long Short-Term Memory neural network [J].
Coelho, Rui Moura ;
Gouveia, Joao ;
Botto, Miguel Ayala ;
Krebs, Hermano Igo ;
Martins, Jorge .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 203
[8]   Convolutional neural network and sensor fusion for obstacle classification in the context of powered prosthetic leg applications [J].
Contreras-Cruz, Marco A. ;
Novo-Torres, Luis ;
Villarreal, Dario J. ;
Ramirez-Paredes, Juan-Pablo .
COMPUTERS & ELECTRICAL ENGINEERING, 2023, 108
[9]  
Dosovitskiy A., 2021, arXiv
[10]   Multi-scale Learning for Multimodal Neurophysiological Signals: Gait Pattern Classification as an Example [J].
Duan, Feng ;
Lv, Yizhi ;
Sun, Zhe ;
Li, Junhua .
NEURAL PROCESSING LETTERS, 2022, 54 (03) :2455-2470