Neural correlates of user learning during long-term BCI training for the Cybathlon competition

被引:11
作者
Tortora, Stefano [1 ,5 ]
Beraldo, Gloria [1 ,2 ]
Bettella, Francesco [3 ]
Formaggio, Emanuela [4 ]
Rubega, Maria [4 ]
Del Felice, Alessandra [4 ,5 ]
Masiero, Stefano [4 ,5 ]
Carli, Ruggero [1 ]
Petrone, Nicola [3 ]
Menegatti, Emanuele [1 ,5 ]
Tonin, Luca [1 ,5 ]
机构
[1] Univ Padua, Dept Informat Engn, Padua, Italy
[2] CNR, Inst Cognit Sci & Technol, Rome, Italy
[3] Univ Padua, Dept Ind Engn, Padua, Italy
[4] Univ Padua, Sect Rehabil, Dept Neurosci, Padua, Italy
[5] Univ Padua, Padova Neurosci Ctr, Padua, Italy
关键词
Mutual learning; User learning; Motor imagery; Brain-computer interface; Riemann geometry; Long-term evaluation; Cybathlon; BRAIN-COMPUTER INTERFACES; MACHINE INTERFACES; EEG; ADAPTATION; PEOPLE; CLASSIFICATION; REORGANIZATION; COMMUNICATION; ALGORITHMS;
D O I
10.1186/s12984-022-01047-x
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Background Brain-computer interfaces (BCIs) are systems capable of translating human brain patterns, measured through electroencephalography (EEG), into commands for an external device. Despite the great advances in machine learning solutions to enhance the performance of BCI decoders, the translational impact of this technology remains elusive. The reliability of BCIs is often unsatisfactory for end-users, limiting their application outside a laboratory environment. Methods We present the analysis on the data acquired from an end-user during the preparation for two Cybathlon competitions, where our pilot won the gold medal twice in a row. These data are of particular interest given the mutual learning approach adopted during the longitudinal training phase (8 months), the long training break in between the two events (1 year) and the demanding evaluation scenario. A multifaceted perspective on long-term user learning is proposed: we enriched the information gathered through conventional metrics (e.g., accuracy, application performances) by investigating novel neural correlates of learning in different neural domains. Results First, we showed that by focusing the training on user learning, the pilot was capable of significantly improving his performance over time even with infrequent decoder re-calibrations. Second, we revealed that the analysis of the within-class modifications of the pilot's neural patterns in the Riemannian domain is more effective in tracking the acquisition and the stabilization of BCI skills, especially after the 1-year break. These results further confirmed the key role of mutual learning in the acquisition of BCI skills, and particularly highlighted the importance of user learning as a key to enhance BCI reliability. Conclusion We firmly believe that our work may open new perspectives and fuel discussions in the BCI field to shift the focus of future research: not only to the machine learning of the decoder, but also in investigating novel training procedures to boost the user learning and the stability of the BCI skills in the long-term. To this end, the analyses and the metrics proposed could be used to monitor the user learning during training and provide a marker guiding the decoder re-calibration to maximize the mutual adaptation of the user to the BCI system.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Neural correlates of user learning during long-term BCI training for the Cybathlon competition
    Stefano Tortora
    Gloria Beraldo
    Francesco Bettella
    Emanuela Formaggio
    Maria Rubega
    Alessandra Del Felice
    Stefano Masiero
    Ruggero Carli
    Nicola Petrone
    Emanuele Menegatti
    Luca Tonin
    Journal of NeuroEngineering and Rehabilitation, 19
  • [2] Long-Term BCI Training of a Tetraplegic User: Adaptive Riemannian Classifiers and User Training
    Benaroch, Camille
    Sadatnejad, Khadijeh
    Roc, Aline
    Appriou, Aurelien
    Monseigne, Thibaut
    Pramij, Smeety
    Mladenovic, Jelena
    Pillette, Lea
    Jeunet, Camille
    Lotte, Fabien
    FRONTIERS IN HUMAN NEUROSCIENCE, 2021, 15
  • [3] Long-Term Mutual Training for the CYBATHLON BCI Race With a Tetraplegic Pilot: A Case Study on Inter-Session Transfer and Intra-Session Adaptation
    Hehenberger, Lea
    Kobler, Reinmar J.
    Lopes-Dias, Catarina
    Srisrisawang, Nitikorn
    Tumfart, Peter
    Uroko, John B.
    Torke, Paul R.
    Mueller-Putz, Gernot R.
    FRONTIERS IN HUMAN NEUROSCIENCE, 2021, 15
  • [4] Editorial: Long Term User Training and Preparation to Succeed in a Closed-Loop BCI Competition
    Mueller-Putz, Gernot R.
    Coyle, Damien
    Lotte, Fabien
    Jin, Jing
    Steyrl, David
    FRONTIERS IN HUMAN NEUROSCIENCE, 2022, 16
  • [5] Long Multi-Stage Training for a Motor-Impaired User in a BCI Competition
    Turi, Federica
    Clerc, Maureen
    Papadopoulo, Theodore
    FRONTIERS IN HUMAN NEUROSCIENCE, 2021, 15
  • [6] Long-term kinesthetic motor imagery practice with a BCI: Impacts on user experience, motor cortex oscillations and BCI performances
    Rimbert, Sebastien
    Fleck, Stephanie
    COMPUTERS IN HUMAN BEHAVIOR, 2023, 146
  • [7] Advances in user-training for mental-imagery-based BCI control: Psychological and cognitive factors and their neural correlates
    Jeunet, C.
    N'Kaoua, B.
    Lotte, F.
    BRAIN-COMPUTER INTERFACES: LAB EXPERIMENTS TO REAL-WORLD APPLICATIONS, 2016, 228 : 3 - 35
  • [8] Design Considerations for Long Term Non-invasive Brain Computer Interface Training With Tetraplegic CYBATHLON Pilot
    Robinson, Neethu
    Chouhan, Tushar
    Mihelj, Ernest
    Kratka, Paulina
    Debraine, Frederic
    Wenderoth, Nicole
    Guan, Cuntai
    Lehner, Rea
    FRONTIERS IN HUMAN NEUROSCIENCE, 2021, 15
  • [9] Distinct types of neural reorganization during long-term learning
    Zhou, Xiao
    Tien, Rex N.
    Ravikumar, Sadhana
    Chase, Steven M.
    JOURNAL OF NEUROPHYSIOLOGY, 2019, 121 (04) : 1329 - 1341
  • [10] Impact of dataset size and long-term ECoG-based BCI usage on deep learning decoders performance
    Sliwowski, Maciej
    Martin, Matthieu
    Souloumiac, Antoine
    Blanchart, Pierre
    Aksenova, Tetiana
    FRONTIERS IN HUMAN NEUROSCIENCE, 2023, 17