Non-immersive Versus Immersive Extended Reality for Motor Imagery Neurofeedback Within a Brain-Computer Interfaces

被引:6
|
作者
Arpaia, Pasquale [1 ,2 ]
Coyle, Damien
Donnarumma, Francesco [3 ,4 ]
Esposito, Antonio [1 ,5 ]
Natalizio, Angela [6 ]
Parvis, Marco [6 ]
机构
[1] Univ Napoli Federico II, Dept Elect Engn & Informat Technol DIETI, Via Claudio 21, I-80138 Naples, Italy
[2] Univ Naples Federico II, Interdept Ctr Res Management & Innovat Healthcare, Naples, Italy
[3] Univ Ulster, Intelligent Syst Res Ctr, Derry, Londonderry, North Ireland
[4] Natl Res Council ISTC CNR, Inst Cognit Sci & Technol, Rome, Italy
[5] Univ Naples Federico II, Ctr Serv Metrol & Tecnol Avanzati CeSMA, Naples, Italy
[6] Politecn Torino, Dept Elect & Telecommun DET, Corso Castelfidardo 39, I-10129 Turin, Italy
来源
EXTENDED REALITY, XR SALENTO 2022, PT II | 2022年 / 13446卷
关键词
Brain-computer interface; Extended reality; Motor imagery; Electroencephalography; Haptics; Neurofeedback;
D O I
10.1007/978-3-031-15553-6_28
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
A sensory feedback was employed for the present work to remap brain signals into sensory information. In particular, sensorimotor rhythms associated with motor imagery were measured as a mean to interact with an extended reality (XR) environment. The aim for such a neurofeedback was to let the user become aware of his/her ability to imagine a movement. A brain-computer interface based on motor imagery was thus implemented by using a consumer-grade electroencephalograph and by taking into account wearable and portable feedback actuators. Visual and vibrotactile sensory feedback modalities were used simultaneously to provide an engaging multimodal feedback in XR. Both a non-immersive and an immersive version of the system were considered and compared. Preliminary validation was carried out with four healthy subjects participating in a total of four sessions on different days. Experiments were conducted according to a wide-spread synchronous paradigm in which an application provides the timing for the motor imagery tasks. Performance was compared in terms of classification accuracy. Overall, subjects preferred the immersive neurofeedback because it allowed higher concentration during experiments, but there was not enough evidence to prove its actual effectiveness and mean classification accuracy resulted about 65%. Meanwhile, classification accuracy resulted higher with the non-immersive neurofeedback, notably it reached about 75%. Future experiments could extend this comparison to more subjects and more sessions, due to the relevance of possible applications in rehabilitation. Moreover, the immersive XR implementation could be improved to provide a greater sense of embodiment.
引用
收藏
页码:407 / 419
页数:13
相关论文
共 50 条
  • [1] On the Assessment of Functional Connectivity in an Immersive Brain-Computer Interface During Motor Imagery
    Alanis-Espinosa, Myriam
    Gutierrez, David
    FRONTIERS IN PSYCHOLOGY, 2020, 11
  • [2] Optimizing Motor Imagery Neurofeedback through the Use of Multimodal Immersive Virtual Reality and Motor Priming
    Vourvopoulos, Athanasios
    Munoz Cardona, John Edison
    Bermudez i Badia, Sergi
    2015 INTERNATIONAL CONFERENCE ON VIRTUAL REHABILITATION PROCEEDINGS (ICVR), 2015, : 228 - 234
  • [3] NeuRow: An Immersive VR Environment for Motor-Imagery Training with the Use of Brain-Computer Interfaces and Vibrotactile Feedback
    Vourvopoulos, Athanasios
    Ferreira, Andre
    Bermudez i Badia, Sergi
    PHYSICS: PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON PHYSIOLOGICAL COMPUTING SYSTEMS, 2016, : 43 - 53
  • [4] Embodiment Is Related to Better Performance on a Brain-Computer Interface in Immersive Virtual Reality: A Pilot Study
    Juliano, Julia M.
    Spicer, Ryan P.
    Vourvopoulos, Athanasios
    Lefebvre, Stephanie
    Jann, Kay
    Ard, Tyler
    Santarnecchi, Emiliano
    Krum, David M.
    Liew, Sook-Lei
    SENSORS, 2020, 20 (04)
  • [5] Visual and haptic feedback in detecting motor imagery within a wearable brain-computer interface
    Arpaia, Pasquale
    Coyle, Damien
    Donnarumma, Francesco
    Esposito, Antonio
    Natalizio, Angela
    Parvis, Marco
    MEASUREMENT, 2023, 206
  • [6] Progressive Training for Motor Imagery Brain-Computer Interfaces Using Gamification and Virtual Reality Embodiment
    Skola, Filip
    Tinkova, Simona
    Liarokapis, Fotis
    FRONTIERS IN HUMAN NEUROSCIENCE, 2019, 13
  • [7] Using Motor Imagery to Control Brain-Computer Interfaces for Communication
    Brumberg, Jonathan S.
    Burnison, Jeremy D.
    Pitt, Kevin M.
    FOUNDATIONS OF AUGMENTED COGNITION: NEUROERGONOMICS AND OPERATIONAL NEUROSCIENCE, AC 2016, PT I, 2016, 9743 : 14 - 25
  • [8] Motor Imagery Classification for Asynchronous EEG-Based Brain-Computer Interfaces
    Wu, Huanyu
    Li, Siyang
    Wu, Dongrui
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2024, 32 : 527 - 536
  • [9] Federated Motor Imagery Classification for Privacy-Preserving Brain-Computer Interfaces
    Jia, Tianwang
    Meng, Lubin
    Li, Siyang
    Liu, Jiajing
    Wu, Dongrui
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2024, 32 : 3442 - 3451
  • [10] Transfer learning for motor imagery based brain-computer interfaces: A tutorial
    Wu, Dongrui
    Jiang, Xue
    Peng, Ruimin
    NEURAL NETWORKS, 2022, 153 : 235 - 253