Neural correlates of user learning during long-term BCI training for the Cybathlon competition

被引:11
作者
Tortora, Stefano [1 ,5 ]
Beraldo, Gloria [1 ,2 ]
Bettella, Francesco [3 ]
Formaggio, Emanuela [4 ]
Rubega, Maria [4 ]
Del Felice, Alessandra [4 ,5 ]
Masiero, Stefano [4 ,5 ]
Carli, Ruggero [1 ]
Petrone, Nicola [3 ]
Menegatti, Emanuele [1 ,5 ]
Tonin, Luca [1 ,5 ]
机构
[1] Univ Padua, Dept Informat Engn, Padua, Italy
[2] CNR, Inst Cognit Sci & Technol, Rome, Italy
[3] Univ Padua, Dept Ind Engn, Padua, Italy
[4] Univ Padua, Sect Rehabil, Dept Neurosci, Padua, Italy
[5] Univ Padua, Padova Neurosci Ctr, Padua, Italy
关键词
Mutual learning; User learning; Motor imagery; Brain-computer interface; Riemann geometry; Long-term evaluation; Cybathlon; BRAIN-COMPUTER INTERFACES; MACHINE INTERFACES; EEG; ADAPTATION; PEOPLE; CLASSIFICATION; REORGANIZATION; COMMUNICATION; ALGORITHMS;
D O I
10.1186/s12984-022-01047-x
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Background Brain-computer interfaces (BCIs) are systems capable of translating human brain patterns, measured through electroencephalography (EEG), into commands for an external device. Despite the great advances in machine learning solutions to enhance the performance of BCI decoders, the translational impact of this technology remains elusive. The reliability of BCIs is often unsatisfactory for end-users, limiting their application outside a laboratory environment. Methods We present the analysis on the data acquired from an end-user during the preparation for two Cybathlon competitions, where our pilot won the gold medal twice in a row. These data are of particular interest given the mutual learning approach adopted during the longitudinal training phase (8 months), the long training break in between the two events (1 year) and the demanding evaluation scenario. A multifaceted perspective on long-term user learning is proposed: we enriched the information gathered through conventional metrics (e.g., accuracy, application performances) by investigating novel neural correlates of learning in different neural domains. Results First, we showed that by focusing the training on user learning, the pilot was capable of significantly improving his performance over time even with infrequent decoder re-calibrations. Second, we revealed that the analysis of the within-class modifications of the pilot's neural patterns in the Riemannian domain is more effective in tracking the acquisition and the stabilization of BCI skills, especially after the 1-year break. These results further confirmed the key role of mutual learning in the acquisition of BCI skills, and particularly highlighted the importance of user learning as a key to enhance BCI reliability. Conclusion We firmly believe that our work may open new perspectives and fuel discussions in the BCI field to shift the focus of future research: not only to the machine learning of the decoder, but also in investigating novel training procedures to boost the user learning and the stability of the BCI skills in the long-term. To this end, the analyses and the metrics proposed could be used to monitor the user learning during training and provide a marker guiding the decoder re-calibration to maximize the mutual adaptation of the user to the BCI system.
引用
收藏
页数:19
相关论文
共 50 条
  • [31] Disengagement of motor cortex from movement control during long-term learning
    Hwang, Eun Jung
    Dahlen, Jeffrey E.
    Hu, Yvonne Yuling
    Aguilar, Karina
    Yu, Bin
    Mukundan, Madan
    Mitani, Akinori
    Komiyama, Takaki
    SCIENCE ADVANCES, 2019, 5 (10)
  • [32] Mining naturalistic human behaviors in long-term video and neural recordings
    Singh, Satpreet H.
    Peterson, Steven M.
    Rao, Rajesh P. N.
    Brunton, Bingni W.
    JOURNAL OF NEUROSCIENCE METHODS, 2021, 358
  • [33] Computer assisted learning in medicine: a long-term evaluation of the 'Practical Training Programme Dermatology 2000'
    Roesch, A
    Gruber, H
    Hawelka, B
    Hamm, H
    Arnold, N
    Popal, H
    Segerer, J
    Landthaler, M
    Stolz, W
    MEDICAL INFORMATICS AND THE INTERNET IN MEDICINE, 2003, 28 (03): : 147 - 159
  • [34] Self-perceived long-term transfer of learning after postpartum hemorrhage simulation training
    Pinto de Melo, Brena Carvalho
    Falbo, Ana Rodrigues
    Sorensen, Jette Led
    van Merrienboer, Jeroen J. G.
    van der Vleuten, Cees
    INTERNATIONAL JOURNAL OF GYNECOLOGY & OBSTETRICS, 2018, 141 (02) : 261 - 267
  • [35] User experience of human-robot long-term interactions
    Laban, Guy
    Kappas, Arvid
    Morrison, Val
    Cross, Emily S.
    PROCEEDINGS OF THE 10TH CONFERENCE ON HUMAN-AGENT INTERACTION, HAI 2022, 2022, : 287 - 289
  • [36] Electrophysiological correlates of higher states of consciousness during sleep in long-term practitioners of the transcendental meditation program
    Mason, LI
    Alexander, CN
    Travis, FT
    Marsh, G
    OrmeJohnson, DW
    Gackenbach, J
    Mason, DC
    Rainforth, M
    Walton, G
    SLEEP, 1997, 20 (02) : 102 - 110
  • [37] Unsupervised online learning for long-term autonomy
    Ott, Lionel
    Ramos, Fabio
    INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2013, 32 (14) : 1724 - 1741
  • [38] The Neuronal Basis of Long-Term Sensorimotor Learning
    Mandelblat-Cerf, Yael
    Novick, Itai
    Paz, Rony
    Link, Yuval
    Freeman, Sharon
    Vaadia, Eilon
    JOURNAL OF NEUROSCIENCE, 2011, 31 (01) : 300 - 313
  • [39] A Transfer Learning Algorithm to Reduce Brain-Computer Interface Calibration Time for Long-Term Users
    Giles, Joshua
    Ang, Kai Keng
    Phua, Kok Soon
    Arvaneh, Mahnaz
    FRONTIERS IN NEUROERGONOMICS, 2022, 3
  • [40] Short- and long-term neuroplasticity interact during the perceptual learning of concurrent speech
    MacLean, Jessica
    Stirn, Jack
    Sisson, Alexandria
    Bidelman, Gavin M.
    CEREBRAL CORTEX, 2024, 34 (02)