Gait Recognition in Different Terrains with IMUs Based on Attention Mechanism Feature Fusion Method

被引:1
作者
Yan, Mengxue [1 ]
Guo, Ming [1 ]
Sun, Jianqiang [1 ]
Qiu, Jianlong [1 ]
Chen, Xiangyong [1 ]
机构
[1] Linyi Univ, Sch Automation & Elect Engn, Lanshan St, Linyi 276000, Shandong, Peoples R China
基金
中国国家自然科学基金;
关键词
Gait recognition; Inertial measurement unit; Lightweight convolutional neural network; Attention mechanism; Feature fusion; POSE ESTIMATION; ALGORITHM;
D O I
10.1007/s11063-023-11324-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Gait recognition is significant in the fields of disease diagnosis and rehabilitation training by studying the characteristics of human gait with different terrain. To address the problem that the transformation of different outdoor terrains can affect the gait of walkers, a gait recognition algorithm based on feature fusion with attention mechanism is proposed. First, the acceleration, angular velocity and angle information collected by the inertial measurement unit is used; then the acquired inertial gait data is divided into periods to obtain the period data of each step; then the features are extracted from the data, followed by the visualization of the one-dimensional data into two-dimensional images. A lightweight model is designed to combine convolutional neural network with attention mechanism, and a new attention mechanism-based feature fusion method is proposed in this paper for extracting features from multiple sensors and fusing them for gait recognition. The comparison experimental results show that the recognition accuracy of the model proposed in this paper can reach 89%, and it has good recognition effect on gait under different terrain.
引用
收藏
页码:10215 / 10234
页数:20
相关论文
共 45 条
  • [1] Melanoma Lesion Detection and Segmentation Using YOLOv4-DarkNet and Active Contour
    Albahli, Saleh
    Nida, Nudrat
    Irtaza, Aun
    Yousaf, Muhammad Haroon
    Mahmood, Muhammad Tariq
    [J]. IEEE ACCESS, 2020, 8 (08): : 198403 - 198414
  • [2] Automated Detection of Instantaneous Gait Events Using Time Frequency Analysis and Manifold Embedding
    Aung, Min S. H.
    Thies, Sibylle B.
    Kenney, Laurence P. J.
    Howard, David
    Selles, Ruud W.
    Findlow, Andrew H.
    Goulermas, John Y.
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2013, 21 (06) : 908 - 916
  • [3] User Authentication by Gait Data from Smartphone Sensors Using Hybrid Deep Learning Network
    Cao, Qian
    Xu, Fei
    Li, Huiyong
    [J]. MATHEMATICS, 2022, 10 (13)
  • [4] Improving Inertial Sensor-Based Activity Recognition in Neurological Populations
    Celik, Yunus
    Aslan, M. Fatih
    Sabanci, Kadir
    Stuart, Sam
    Woo, Wai Lok
    Godfrey, Alan
    [J]. SENSORS, 2022, 22 (24)
  • [5] Flexible Piezoelectric Sensor-Based Gait Recognition
    Cha, Youngsu
    Kim, Hojoon
    Kim, Doik
    [J]. SENSORS, 2018, 18 (02)
  • [6] Choi S, 2014, INT CONF COMPUT NETW, P1091, DOI 10.1109/ICCNC.2014.6785491
  • [7] Real-time walking gait terrain classification from foot-mounted Inertial Measurement Unit using Convolutional Long Short-Term Memory neural network
    Coelho, Rui Moura
    Gouveia, Joao
    Botto, Miguel Ayala
    Krebs, Hermano Igo
    Martins, Jorge
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2022, 203
  • [8] Convolutional neural network and sensor fusion for obstacle classification in the context of powered prosthetic leg applications
    Contreras-Cruz, Marco A.
    Novo-Torres, Luis
    Villarreal, Dario J.
    Ramirez-Paredes, Juan-Pablo
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2023, 108
  • [9] Dosovitskiy A., 2020, ICLR, V20, DOI 10.48550/arXiv.2010.11929
  • [10] Multi-scale Learning for Multimodal Neurophysiological Signals: Gait Pattern Classification as an Example
    Duan, Feng
    Lv, Yizhi
    Sun, Zhe
    Li, Junhua
    [J]. NEURAL PROCESSING LETTERS, 2022, 54 (03) : 2455 - 2470