Neural correlates of user learning during long-term BCI training for the Cybathlon competition

被引:13
作者
Tortora, Stefano [1 ,5 ]
Beraldo, Gloria [1 ,2 ]
Bettella, Francesco [3 ]
Formaggio, Emanuela [4 ]
Rubega, Maria [4 ]
Del Felice, Alessandra [4 ,5 ]
Masiero, Stefano [4 ,5 ]
Carli, Ruggero [1 ]
Petrone, Nicola [3 ]
Menegatti, Emanuele [1 ,5 ]
Tonin, Luca [1 ,5 ]
机构
[1] Univ Padua, Dept Informat Engn, Padua, Italy
[2] CNR, Inst Cognit Sci & Technol, Rome, Italy
[3] Univ Padua, Dept Ind Engn, Padua, Italy
[4] Univ Padua, Sect Rehabil, Dept Neurosci, Padua, Italy
[5] Univ Padua, Padova Neurosci Ctr, Padua, Italy
关键词
Mutual learning; User learning; Motor imagery; Brain-computer interface; Riemann geometry; Long-term evaluation; Cybathlon; BRAIN-COMPUTER INTERFACES; MACHINE INTERFACES; EEG; ADAPTATION; PEOPLE; CLASSIFICATION; REORGANIZATION; COMMUNICATION; ALGORITHMS;
D O I
10.1186/s12984-022-01047-x
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Background Brain-computer interfaces (BCIs) are systems capable of translating human brain patterns, measured through electroencephalography (EEG), into commands for an external device. Despite the great advances in machine learning solutions to enhance the performance of BCI decoders, the translational impact of this technology remains elusive. The reliability of BCIs is often unsatisfactory for end-users, limiting their application outside a laboratory environment. Methods We present the analysis on the data acquired from an end-user during the preparation for two Cybathlon competitions, where our pilot won the gold medal twice in a row. These data are of particular interest given the mutual learning approach adopted during the longitudinal training phase (8 months), the long training break in between the two events (1 year) and the demanding evaluation scenario. A multifaceted perspective on long-term user learning is proposed: we enriched the information gathered through conventional metrics (e.g., accuracy, application performances) by investigating novel neural correlates of learning in different neural domains. Results First, we showed that by focusing the training on user learning, the pilot was capable of significantly improving his performance over time even with infrequent decoder re-calibrations. Second, we revealed that the analysis of the within-class modifications of the pilot's neural patterns in the Riemannian domain is more effective in tracking the acquisition and the stabilization of BCI skills, especially after the 1-year break. These results further confirmed the key role of mutual learning in the acquisition of BCI skills, and particularly highlighted the importance of user learning as a key to enhance BCI reliability. Conclusion We firmly believe that our work may open new perspectives and fuel discussions in the BCI field to shift the focus of future research: not only to the machine learning of the decoder, but also in investigating novel training procedures to boost the user learning and the stability of the BCI skills in the long-term. To this end, the analyses and the metrics proposed could be used to monitor the user learning during training and provide a marker guiding the decoder re-calibration to maximize the mutual adaptation of the user to the BCI system.
引用
收藏
页数:19
相关论文
共 73 条
[1]   Measurement of functional task difficulty during motor learning: What level of difficulty corresponds to the optimal challenge point? [J].
Akizuki, Kazunori ;
Ohashi, Yukari .
HUMAN MOVEMENT SCIENCE, 2015, 43 :107-117
[2]   BCI Demographics: How Many (and What Kinds of) People Can Use an SSVEP BCI? [J].
Allison, Brendan ;
Lueth, Thorsten ;
Valbuena, Diana ;
Teymourian, Amir ;
Volosyak, Ivan ;
Graeser, Axel .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2010, 18 (02) :107-116
[3]  
[Anonymous], 2017, OPERATION HDB BRAIN
[4]  
[Anonymous], 2017, P 7 GRAZ BRAIN COMP
[5]   Identifying Resting-State Functional Connectivity Changes in the Motor Cortex Using fNIRS During Recovery from Stroke [J].
Arun, K. M. ;
Smitha, K. A. ;
Sylaja, P. N. ;
Kesavadas, Chandrasekharan .
BRAIN TOPOGRAPHY, 2020, 33 (06) :710-719
[6]   Immediate and long-term effects of BCI-based rehabilitation of the upper extremity after stroke: a systematic review and meta-analysis [J].
Bai, Zhongfei ;
Fong, Kenneth N. K. ;
Zhang, Jack Jiaqi ;
Chan, Josephine ;
Ting, K. H. .
JOURNAL OF NEUROENGINEERING AND REHABILITATION, 2020, 17 (01)
[7]   Classification of covariance matrices using a Riemannian-based kernel for BCI applications [J].
Barachant, Alexandre ;
Bonnet, Stephane ;
Congedo, Marco ;
Jutten, Christian .
NEUROCOMPUTING, 2013, 112 :172-178
[8]   Long-Term BCI Training of a Tetraplegic User: Adaptive Riemannian Classifiers and User Training [J].
Benaroch, Camille ;
Sadatnejad, Khadijeh ;
Roc, Aline ;
Appriou, Aurelien ;
Monseigne, Thibaut ;
Pramij, Smeety ;
Mladenovic, Jelena ;
Pillette, Lea ;
Jeunet, Camille ;
Lotte, Fabien .
FRONTIERS IN HUMAN NEUROSCIENCE, 2021, 15
[9]   Shared Intelligence for Robot Teleoperation via BMI [J].
Beraldo, Gloria ;
Tonin, Luca ;
Millan, Jose del R. ;
Menegatti, Emanuele .
IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2022, 52 (03) :400-409
[10]  
Beraldo G, 2020, IEEE SYS MAN CYBERN, P2031, DOI [10.1109/smc42975.2020.9282968, 10.1109/SMC42975.2020.9282968]