Learning architecture for the recognition of walking and prediction of gait period using wearable sensors

被引:7
作者
Martinez-Hernandez, Uriel [1 ]
Awad, Mohammed I. [2 ]
Dehghani-Sanij, Abbas A. [3 ]
机构
[1] Univ Bath, Dept Elect & Elect Engn, Ctr Autonomous Robot CENTAUR, Bath BA2 7AY, Avon, England
[2] Ain Shams Univ, Dept Mechatron Engn, Cairo, Egypt
[3] Univ Leeds, Sch Mech Engn, Leeds, W Yorkshire, England
基金
英国工程与自然科学研究理事会;
关键词
Activity recognition; Deep learning; Learning architectures; Wearable sensors; INTENT RECOGNITION; CLASSIFICATION; ALGORITHMS; LOCOMOTION; NETWORKS; SYSTEM;
D O I
10.1016/j.neucom.2021.10.044
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This work presents a novel learning architecture for the recognition and prediction of walking activity and gait period, respectively, using wearable sensors. This approach is composed of a Convolutional Neural Network (CNN), a Predicted Information Gain (PIG) module and an adaptive combination of infor-mation sources. The CNN provides the recognition of walking and gait periods. This information is used by the proposed PIG method to estimate the next most probable gait period along the gait cycle. The out-puts from the CNN and PIG modules are combined by a proposed adaptive process, which relies on data from the source that shows to be more reliable. This adaptive combination ensures that the learning architecture provides accurate recognition and prediction of walking activity and gait periods over time. The learning architecture uses data from an array of three inertial measurement units attached to the lower limbs of individuals. The validation of this work is performed by the recognition of level-ground walking, ramp ascent and ramp descent, and the prediction of gait periods. The recognition of walking activity and gait period is 100% and 98.63%, respectively, when the CNN model is employed alone. The recognition of gait periods achieves a 99.9% accuracy, when the PIG method and adaptive combination are also used. These results demonstrate the benefit of having a system capable of predicting or antici-pating the next information or event over time. Overall, the learning architecture offers an alternative approach for accurate activity recognition, which is essential for the development of wearable robots cap-able of reliably and safely assisting humans in activities of daily living. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码:1 / 10
页数:10
相关论文
共 45 条
[1]   Stronger, Smarter, Softer Next-Generation Wearable Robots [J].
Asbeck, Alan T. ;
De Rossi, Stefano M. M. ;
Galiana, Ignacio ;
Ding, Ye ;
Walsh, Conor J. .
IEEE ROBOTICS & AUTOMATION MAGAZINE, 2014, 21 (04) :22-33
[2]   Fuzzy EMG classification for prosthesis control [J].
Chan, FHY ;
Yang, YS ;
Lam, FK ;
Zhang, YT ;
Parker, PA .
IEEE TRANSACTIONS ON REHABILITATION ENGINEERING, 2000, 8 (03) :305-311
[3]   Recent developments and challenges of lower extremity exoskeletons [J].
Chen, Bing ;
Ma, Hao ;
Qin, Lai-Yin ;
Gao, Fei ;
Chan, Kai-Ming ;
Law, Sheung-Wai ;
Qin, Ling ;
Liao, Wei-Hsin .
JOURNAL OF ORTHOPAEDIC TRANSLATION, 2016, 5 :26-37
[4]   Improving Human Action Recognition Using Fusion of Depth Camera and Inertial Sensors [J].
Chen, Chen ;
Jafari, Roozbeh ;
Kehtarnavaz, Nasser .
IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2015, 45 (01) :51-61
[5]  
Farrell M.T., 2013, THESIS MIT
[6]   Recognizing Human Activity in Free-Living Using Multiple Body-Worn Accelerometers [J].
Fullerton, Elliott ;
Heller, Ben ;
Munoz-Organero, Mario .
IEEE SENSORS JOURNAL, 2017, 17 (16) :5290-5297
[7]   Human Activity Recognition Process Using 3-D Posture Data [J].
Gaglio, Salvatore ;
Lo Re, Giuseppe ;
Morana, Marco .
IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2015, 45 (05) :586-597
[8]   Stance and Swing Detection Based on the Angular Velocity of Lower Limb Segments During Walking [J].
Grimmer, Martin ;
Schmidt, Kai ;
Duarte, Jaime E. ;
Neuner, Lukas ;
Koginov, Gleb ;
Riener, Robert .
FRONTIERS IN NEUROROBOTICS, 2019, 13
[9]   Non-weight-bearing neural control of a powered transfemoral prosthesis [J].
Hargrove, Levi J. ;
Simon, Ann M. ;
Lipschutz, Robert ;
Finucane, Suzanne B. ;
Kuiken, Todd A. .
JOURNAL OF NEUROENGINEERING AND REHABILITATION, 2013, 10
[10]   Continuous Locomotion-Mode Identification for Prosthetic Legs Based on Neuromuscular-Mechanical Fusion [J].
Huang, He ;
Zhang, Fan ;
Hargrove, Levi J. ;
Dou, Zhi ;
Rogers, Daniel R. ;
Englehart, Kevin B. .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2011, 58 (10) :2867-2875