IMU-Based Deep Neural Networks: Prediction of Locomotor and Transition Intentions of an Osseointegrated Transfemoral Amputee

被引:28
作者
Bruinsma, Julian [1 ]
Carloni, Raffaella [1 ]
机构
[1] Univ Groningen, Fac Sci & Engn, Bernoulli Inst Math Comp Sci & Artificial Intelli, NL-9745 AG Groningen, Netherlands
关键词
Time-domain analysis; Prosthetics; Legged locomotion; Accelerometers; Feature extraction; Recurrent neural networks; Knee; Deep neural networks; lower-limb prosthetic; RECOGNITION; CLASSIFICATION; STRATEGY;
D O I
10.1109/TNSRE.2021.3086843
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
This paper focuses on the design and comparison of different deep neural networks for the real-time prediction of locomotor and transition intentions of one osseointegrated transfemoral amputee using only data from inertial measurement units. The deep neural networks are based on convolutional neural networks, recurrent neural networks, and convolutional recurrent neural networks. The architectures' input are features in both the time domain and the time-frequency domain, which are derived from either one inertial measurement unit (placed above the prosthetic knee) or two inertial measurement units (placed above and below the prosthetic knee). The prediction of eight different locomotion modes (i.e., sitting, standing, level ground walking, stair ascent and descent, ramp ascent and descent, walking on uneven terrain) and the twenty-four transitions among them is investigated. The study shows that a recurrent neural network, realized with four layers of gated recurrent unit networks, achieves (with a 5-fold cross-validation) a mean F1 score of 84.78% and 86.50% using one inertial measurement unit, and 93.06% and 89.99% using two inertial measurement units, with or without sitting, respectively.
引用
收藏
页码:1079 / 1088
页数:10
相关论文
共 34 条
[1]  
Alsheikh M. A., 2016, PROC WORKSHOPS 30 AA, P8
[2]   Human Activity Recognition with Convolutional Neural Networks [J].
Bevilacqua, Antonio ;
MacDonald, Kyle ;
Rangarej, Aamina ;
Widjaya, Venessa ;
Caulfield, Brian ;
Kechadi, Tahar .
MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2018, PT III, 2019, 11053 :541-552
[3]   Machine Learning Model Comparisons of User Independent & Dependent Intent Recognition Systems for Powered Prostheses [J].
Bhakta, Krishan ;
Camargo, Jonathan ;
Donovan, Luke ;
Herrin, Kinsey ;
Young, Aaron .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (04) :5393-5400
[4]   A Machine Learning Strategy for Locomotion Classification and Parameter Estimation Using Fusion of Wearable Sensors [J].
Camargo, Jonathan ;
Flanagan, Will ;
Csomay-Shanklin, Noel ;
Kanwar, Bharat ;
Young, Aaron .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2021, 68 (05) :1569-1578
[5]   A Locomotion Intent Prediction System Based on Multi-Sensor Fusion [J].
Chen, Baojun ;
Zheng, Enhao ;
Wang, Qining .
SENSORS, 2014, 14 (07) :12349-12369
[6]   Determining motions with an IMU during level walking and slope and stair walking [J].
Chen, Wei-Han ;
Lee, Yin-Shin ;
Yang, Ching-Jui ;
Chang, Su-Yu ;
Shih, Yo ;
Sui, Jien-De ;
Chang, Tian-Sheuan ;
Shiang, Tzyy-Yuang .
JOURNAL OF SPORTS SCIENCES, 2020, 38 (01) :62-69
[7]  
Cho K., 2014, C EMP METH NAT LANG, P1724, DOI [10.3115/v1/D14-1179, DOI 10.3115/V1/D14-1179]
[8]   IMU-Based Gait Recognition Using Convolutional Neural Networks and Multi-Sensor Fusion [J].
Dehzangi, Omid ;
Taherisadr, Mojtaba ;
ChangalVala, Raghvendar .
SENSORS, 2017, 17 (12)
[9]   PEEK An LSTM Recurrent Network for Motion Classification from Sparse Data [J].
Drumond, Rafael Rego ;
Dorta Marques, Bruno A. ;
Vasconcelos, Cristina Nader ;
Clua, Esteban .
PROCEEDINGS OF THE 13TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL 1: GRAPP, 2018, :215-222
[10]   Daily Locomotion Recognition and Prediction: A Kinematic Data-Based Machine Learning Approach [J].
Figueiredo, Joana ;
Carvalho, Simao P. ;
Goncalve, Diogo ;
Moreno, Juan C. ;
Santos, Cristina P. .
IEEE ACCESS, 2020, 8 :33250-33262