Embodied VR environment facilitates motor imagery brain-computer interface training

被引:42
作者
Skola, Filip [1 ]
Liarokapis, Fotis [1 ]
机构
[1] Masaryk Univ, Fac Informat, Bot 68a, Brno, Czech Republic
来源
COMPUTERS & GRAPHICS-UK | 2018年 / 75卷
关键词
Motor imagery; Brain-Computer interfaces; Virtual reality; Embodiment; Rubber hand illusion; Body transfer illusion; BODY OWNERSHIP ILLUSION; RUBBER HAND ILLUSION; SINGLE-TRIAL EEG; ILLUSORY OWNERSHIP; VIRTUAL BODY; COMMUNICATION; FEEDBACK; VISUOTACTILE; REAL; TIME;
D O I
10.1016/j.cag.2018.05.024
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Motor imagery (MI) is the predominant control paradigm for brain-computer interfaces (BCIs). After sufficient effort is invested to the training, the accuracy of commands mediated by mental imagery of bodily movements grows to a satisfactory level. However, many issues with the MI-BCIs persist; e.g., low bit transfer rate, BCI illiteracy, sub-optimal training procedure. Especially the training process for the MI-BCIs requires improvements. Currently, the training has an inappropriate form, resulting in a high mental and temporal demand on the users (weeks of training are required for the control). This study aims at addressing the issues with the MI-BCI training. To support the learning process, an embodied training environment was created. Participants were placed into a virtual reality environment observed from a first-person view of a human-like avatar, and their rehearsal of MI actions was reflected by the corresponding movements performed by the avatar. Leveraging extension of the sense of ownership, agency, and self-location towards a non-body object (principles known from the rubber hand illusion and the body transfer illusions) has already been proven to help in producing stronger EEG correlates of Ml. These principles were used to facilitate the MI-BCI training process for the first time. Performance of 30 healthy participants after two sessions of training was measured using an on-line BCI scenario. The group trained using our embodied VR environment gained significantly higher average accuracy for BCI actions (58.3%) than the control group, trained with a standard MI-BCI training protocol (52.9%). (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:59 / 71
页数:13
相关论文
共 50 条
  • [41] A method from offline analysis to online training for the brain-computer interface based on motor imagery and speech imagery
    Wang, Li
    Huang, Weijian
    Yang, Zhao
    Hu, Xiao
    Zhang, Chun
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2020, 62
  • [42] Virtual Reality Embodiment in Motor Imagery Brain–Computer Interface Training
    Škola F.
    Liarokapis F.
    SN Computer Science, 4 (1)
  • [43] Discrimination of Rest, Motor Imagery and Movement for Brain-Computer Interface Applications
    Ozturk, Nedime
    Yilmaz, Bulent
    2018 MEDICAL TECHNOLOGIES NATIONAL CONGRESS (TIPTEKNO), 2018,
  • [44] Thinking Penguin: Multimodal Brain-Computer Interface Control of a VR Game
    Leeb, Robert
    Lancelle, Marcel
    Kaiser, Vera
    Fellner, Dieter W.
    Pfurtscheller, Gert
    IEEE TRANSACTIONS ON COMPUTATIONAL INTELLIGENCE AND AI IN GAMES, 2013, 5 (02) : 117 - 128
  • [45] Development of a Wearable Motor-Imagery-Based Brain-Computer Interface
    Lin, Bor-Shing
    Pan, Jeng-Shyang
    Chu, Tso-Yao
    Lin, Bor-Shyh
    JOURNAL OF MEDICAL SYSTEMS, 2016, 40 (03) : 1 - 8
  • [46] Reducing Brain-computer Interaction Training Time with Embodied Virtual Avatar
    Skola, Filip
    Liarokapis, Fotis
    GRAPP: PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL 1: GRAPP, 2022, : 7 - 17
  • [47] Implementation of a brain-computer interface based on three states of motor imagery
    Wang, Yijun
    Hong, Bo
    Gao, Xiaorong
    Gao, Shangkai
    2007 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-16, 2007, : 5059 - 5062
  • [48] A Predictive Speller Controlled by a Brain-Computer Interface Based on Motor Imagery
    D'Albis, Tiziano
    Blatt, Rossella
    Tedesco, Roberto
    Sbattella, Licia
    Matteucci, Matteo
    ACM TRANSACTIONS ON COMPUTER-HUMAN INTERACTION, 2012, 19 (03)
  • [49] Metrological performance of a single-channel Brain-Computer Interface based on Motor Imagery
    Angrisani, Leopoldo
    Arpaia, Pasquale
    Donnarumma, Francesco
    Esposito, Antonio
    Moccaldi, Nicola
    Parvis, Marco
    2019 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE (I2MTC), 2019, : 1286 - 1290
  • [50] Integrating EEG and MEG Signals to Improve Motor Imagery Classification in Brain-Computer Interface
    Corsi, Marie-Constance
    Chavez, Mario
    Schwartz, Denis
    Hugueville, Laurent
    Khambhati, Ankit N.
    Bassett, Danielle S.
    Fallani, Fabrizio De Vico
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2019, 29 (01)