Non-immersive Versus Immersive Extended Reality for Motor Imagery Neurofeedback Within a Brain-Computer Interfaces

被引:6
|
作者
Arpaia, Pasquale [1 ,2 ]
Coyle, Damien
Donnarumma, Francesco [3 ,4 ]
Esposito, Antonio [1 ,5 ]
Natalizio, Angela [6 ]
Parvis, Marco [6 ]
机构
[1] Univ Napoli Federico II, Dept Elect Engn & Informat Technol DIETI, Via Claudio 21, I-80138 Naples, Italy
[2] Univ Naples Federico II, Interdept Ctr Res Management & Innovat Healthcare, Naples, Italy
[3] Univ Ulster, Intelligent Syst Res Ctr, Derry, Londonderry, North Ireland
[4] Natl Res Council ISTC CNR, Inst Cognit Sci & Technol, Rome, Italy
[5] Univ Naples Federico II, Ctr Serv Metrol & Tecnol Avanzati CeSMA, Naples, Italy
[6] Politecn Torino, Dept Elect & Telecommun DET, Corso Castelfidardo 39, I-10129 Turin, Italy
来源
EXTENDED REALITY, XR SALENTO 2022, PT II | 2022年 / 13446卷
关键词
Brain-computer interface; Extended reality; Motor imagery; Electroencephalography; Haptics; Neurofeedback;
D O I
10.1007/978-3-031-15553-6_28
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
A sensory feedback was employed for the present work to remap brain signals into sensory information. In particular, sensorimotor rhythms associated with motor imagery were measured as a mean to interact with an extended reality (XR) environment. The aim for such a neurofeedback was to let the user become aware of his/her ability to imagine a movement. A brain-computer interface based on motor imagery was thus implemented by using a consumer-grade electroencephalograph and by taking into account wearable and portable feedback actuators. Visual and vibrotactile sensory feedback modalities were used simultaneously to provide an engaging multimodal feedback in XR. Both a non-immersive and an immersive version of the system were considered and compared. Preliminary validation was carried out with four healthy subjects participating in a total of four sessions on different days. Experiments were conducted according to a wide-spread synchronous paradigm in which an application provides the timing for the motor imagery tasks. Performance was compared in terms of classification accuracy. Overall, subjects preferred the immersive neurofeedback because it allowed higher concentration during experiments, but there was not enough evidence to prove its actual effectiveness and mean classification accuracy resulted about 65%. Meanwhile, classification accuracy resulted higher with the non-immersive neurofeedback, notably it reached about 75%. Future experiments could extend this comparison to more subjects and more sessions, due to the relevance of possible applications in rehabilitation. Moreover, the immersive XR implementation could be improved to provide a greater sense of embodiment.
引用
收藏
页码:407 / 419
页数:13
相关论文
共 50 条
  • [21] Privacy-Preserving Domain Adaptation for Motor Imagery-Based Brain-Computer Interfaces
    Xia, Kun
    Deng, Lingfei
    Duch, Wlodzislaw
    Wu, Dongrui
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2022, 69 (11) : 3365 - 3376
  • [22] Review of public motor imagery and execution datasets in brain-computer interfaces
    Gwon, Daeun
    Won, Kyungho
    Song, Minseok
    Nam, Chang S.
    Jun, Sung Chan
    Ahn, Minkyu
    FRONTIERS IN HUMAN NEUROSCIENCE, 2023, 17
  • [23] Crosstalk disrupts the production of motor imagery brain signals in brain-computer interfaces
    Neo, Phoebe S. -H.
    Mayne, Terence
    Fu, Xiping
    Huang, Zhiyi
    Franz, Elizabeth A.
    HEALTH INFORMATION SCIENCE AND SYSTEMS, 2021, 9 (01)
  • [24] Exploring the Visual Guidance of Motor Imagery in Sustainable Brain-Computer Interfaces
    Yang, Cheng
    Kong, Lei
    Zhang, Zhichao
    Tao, Ye
    Chen, Xiaoyu
    SUSTAINABILITY, 2022, 14 (21)
  • [25] The use of EEG modifications due to motor imagery for brain-computer interfaces
    Cincotti, F
    Mattia, D
    Babiloni, C
    Carducci, F
    Salinari, S
    Bianchi, L
    Marciani, MG
    Babiloni, F
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2003, 11 (02) : 131 - 133
  • [26] Phase-based features for Motor Imagery Brain-Computer Interfaces
    Hamner, Benjamin
    Leeb, Robert
    Tavella, Michele
    Millan, Jose del R.
    2011 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2011, : 2578 - 2581
  • [27] A correntropy-based classifier for motor imagery brain-computer interfaces
    Suarez Uribe, Luisa Fernanda
    Stefano Filho, Carlos Alberto
    de Oliveira, Vinicius Alves
    da Silva Costa, Thiago Bulhoes
    Rodrigues, Paula Gabrielly
    Soriano, Diogo Coutinho
    Boccato, Levy
    Castellano, Gabriela
    Attux, Romis
    BIOMEDICAL PHYSICS & ENGINEERING EXPRESS, 2019, 5 (06):
  • [28] USING AUTOENCODERS FOR FEATURE ENHANCEMENT IN MOTOR IMAGERY BRAIN-COMPUTER INTERFACES
    Helal, Mahmoud A.
    Eldawlatly, Seif
    Taher, Mohamed
    2017 13TH IASTED INTERNATIONAL CONFERENCE ON BIOMEDICAL ENGINEERING (BIOMED), 2017, : 89 - 93
  • [29] Testing Brain-Computer Interfaces with Airplane Pilots under New Motor Imagery Tasks
    Rodriguez-Bermudez, German
    Lopez-Belchi, Alejandro
    Girault, Arnaud
    INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE SYSTEMS, 2019, 12 (02) : 937 - 946
  • [30] Online processing for motor imagery-based brain-computer interfaces relying on EEG
    Arpaia, Pasquale
    Esposito, Antonio
    Moccaldi, Nicola
    Natalizio, Angela
    Parvis, Marco
    2023 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE, I2MTC, 2023,