XAI for myo-controlled prosthesis: Explaining EMG data for hand gesture classification

被引:38
作者
Gozzi, Noemi [1 ,4 ]
Malandri, Lorenzo [2 ,3 ]
Mercorio, Fabio [2 ,3 ]
Pedrocchi, Alessandra [1 ]
机构
[1] Politecn Milan, Dept Elect Informat & Bioengn, Milan, Italy
[2] Univ Milano Bicocca, CRISP Res Ctr, Milan, Italy
[3] Univ Milano Bicocca, Dept Stat & Quantitat Methods, Milan, Italy
[4] Swiss Fed Inst Technol, Dept Hlth Sci & Technol, Lab Neuroengn, Zurich, Switzerland
关键词
EMG signal decoding; eXplainable AI; Myo-controlled prosthesis; NEURAL-NETWORKS; RECOGNITION; SELECTION;
D O I
10.1016/j.knosys.2021.108053
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Machine Learning has recently found a fertile ground in EMG signal decoding for prosthesis control. However, its understanding and acceptance are strongly limited by the notion of AI models as blackboxes. In critical fields, such as medicine and neuroscience, understanding the neurophysiological phenomena underlying models' outcomes is as relevant as the classification performances. In this work, we adapt state-of-the-art XAI algorithms to EMG hand gesture classification to understand the outcome of machine learning models with respect to physiological processes, evaluating the contribution of each input feature to the prediction and showing that AI models recognize the hand gestures by mapping and fusing efficiently high amplitude activity of synergic muscles.This allows us to (i) drastically reduce the number of required electrodes without a significant loss in classification performances, ensuring the suitability of the system for a larger population of amputees and simplifying the realization of near real-time applications and (ii) perform an efficient selection of features based on their classification relevance, apprehended by the XAI algorithms. This feature selection leads to classification improvements in term of robustness and computational time, outperforming correlation based methods. Finally, (iii) comparing the physiological explanations produced by the XAI algorithms with the experimental setting highlights inconsistencies in the electrodes positioning over different rounds or users, then improving the overall quality of the process.(c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:17
相关论文
共 59 条
[1]   Classification of Finger Movements for the Dexterous Hand Prosthesis Control With Surface Electromyography [J].
Al-Timemy, Ali H. ;
Bugmann, Guido ;
Escudero, Javier ;
Outram, Nicholas .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2013, 17 (03) :608-618
[2]   Electromyography data for non-invasive naturally-controlled robotic hand prostheses [J].
Atzori, Manfredo ;
Gijsberts, Arjan ;
Castellini, Claudio ;
Caputo, Barbara ;
Hager, Anne-Gabrielle Mittaz ;
Elsig, Simone ;
Giatsidis, Giorgio ;
Bassetto, Franco ;
Muller, Henning .
SCIENTIFIC DATA, 2014, 1
[3]   Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI [J].
Barredo Arrieta, Alejandro ;
Diaz-Rodriguez, Natalia ;
Del Ser, Javier ;
Bennetot, Adrien ;
Tabik, Siham ;
Barbado, Alberto ;
Garcia, Salvador ;
Gil-Lopez, Sergio ;
Molina, Daniel ;
Benjamins, Richard ;
Chatila, Raja ;
Herrera, Francisco .
INFORMATION FUSION, 2020, 58 :82-115
[4]   Evaluation of the forearm EMG signal features for the control of a prosthetic hand [J].
Boostani, R ;
Moradi, MH .
PHYSIOLOGICAL MEASUREMENT, 2003, 24 (02) :309-319
[5]  
Burkart N, 2021, J ARTIF INTELL RES, V70, P245
[6]   Interpreting Deep Learning Features for Myoelectric Control: A Comparison With Handcrafted Features [J].
Cote-Allard, Ulysse ;
Campbell, Evan ;
Phinyomark, Angkoon ;
Laviolette, Francois ;
Gosselin, Benoit ;
Scheme, Erik .
FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2020, 8
[7]   Deep Learning for Electromyographic Hand Gesture Signal Classification Using Transfer Learning [J].
Cote-Allard, Ulysse ;
Fall, Cheikh Latyr ;
Drouin, Alexandre ;
Campeau-Lecours, Alexandre ;
Gosselin, Clement ;
Glette, Kyrre ;
Laviolette, Francois ;
Gosselin, Benoit .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2019, 27 (04) :760-771
[8]   Surface EMG-Based Inter-Session Gesture Recognition Enhanced by Deep Domain Adaptation [J].
Du, Yu ;
Jin, Wenguang ;
Wei, Wentao ;
Hu, Yu ;
Geng, Weidong .
SENSORS, 2017, 17 (03)
[9]   Classification of the myoelectric signal using time-frequency based representations [J].
Engelhart, K ;
Hudgins, B ;
Parker, PA ;
Stevenson, M .
MEDICAL ENGINEERING & PHYSICS, 1999, 21 (6-7) :431-438
[10]  
Frosst Nicholas., 2017, CORR