Visual and haptic feedback in detecting motor imagery within a wearable brain-computer interface

被引:11
作者
Arpaia, Pasquale [1 ,2 ,3 ]
Coyle, Damien [4 ]
Donnarumma, Francesco [1 ,5 ]
Esposito, Antonio [1 ,6 ]
Natalizio, Angela [1 ,6 ]
Parvis, Marco [6 ]
机构
[1] Augmented Real Hlth Monitoring Lab ARHeMLab, Naples, Italy
[2] Univ Napoli Federico II, Dept Elect Engn & Informat Technol DIETI, Naples, Italy
[3] Univ Napoli Federico II, Ctr Interdipartimentale Ric Management Sanit & Inn, Naples, Italy
[4] Univ Ulster, Intelligent Syst Res Ctr, Derry, North Ireland
[5] Natl Res Council ISTC CNR, Inst Cognit Sci & Technol, Rome, Italy
[6] Politecn Torino, Dept Elect & Telecommun DET, Turin, Italy
基金
英国工程与自然科学研究理事会;
关键词
Brain-computer interface; Motor imagery; Electroencephalography; Extended reality; Haptic; Neurofeedback;
D O I
10.1016/j.measurement.2022.112304
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
This paper presents a wearable brain-computer interface relying on neurofeedback in extended reality for the enhancement of motor imagery training. Visual and vibrotactile feedback modalities were evaluated when presented either singularly or simultaneously. Only three acquisition channels and state-of-the-art vibrotactile chest-based feedback were employed. Experimental validation was carried out with eight subjects participating in two or three sessions on different days, with 360 trials per subject per session. Neurofeedback led to statistically significant improvement in performance over the two/three sessions, thus demonstrating for the first time functionality of a motor imagery-based instrument even by using an utmost wearable electroencephalograph and a commercial gaming vibrotactile suit. In the best cases, classification accuracy exceeded 80% with more than 20% improvement with respect to the initial performance. No feedback modality was generally preferable across the cohort study, but it is concluded that the best feedback modality may be subject-dependent.
引用
收藏
页数:9
相关论文
共 56 条
[1]   Design and evaluation of action observation and motor imagery based BCIs using Near-Infrared Spectroscopy [J].
Abibullaev, Berdakh ;
An, Jinung ;
Lee, Seung Hyun ;
Moon, Jeon Il .
MEASUREMENT, 2017, 98 :250-261
[2]   A comprehensive review of EEG-based brain-computer interface paradigms [J].
Abiri, Reza ;
Borhani, Soheil ;
Sellers, Eric W. ;
Jiang, Yang ;
Zhao, Xiaopeng .
JOURNAL OF NEURAL ENGINEERING, 2019, 16 (01)
[3]   Adding Tactile Feedback and Changing ISI to Improve BCI Systems' Robustness: An Error-Related Potential Study [J].
Ahkami, Bahareh ;
Ghassemi, Farnaz .
BRAIN TOPOGRAPHY, 2021, 34 (04) :467-477
[4]   Effect of biased feedback on motor imagery learning in BCI-teleoperation system [J].
Alimardani, Maryam ;
Nishio, Shuichi ;
Ishiguro, Hiroshi .
FRONTIERS IN SYSTEMS NEUROSCIENCE, 2014, 8
[5]   Filter bank common spatial pattern algorithm on BCI competition IV Datasets 2a and 2b [J].
Ang, Kai Keng ;
Chin, Zheng Yang ;
Wang, Chuanchu ;
Guan, Cuntai ;
Zhang, Haihong .
FRONTIERS IN NEUROSCIENCE, 2012, 6
[6]   A Wearable Brain-Computer Interface Instrument for Augmented Reality-Based Inspection in Industry 4.0 [J].
Angrisani, Leopoldo ;
Arpaia, Pasquale ;
Esposito, Antonio ;
Moccaldi, Nicola .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (04) :1530-1539
[7]  
[Anonymous], 2008, BCI Competition 2008-Graz data set A, V16, P1
[8]  
[Anonymous], 2012, Towards Practical Brain-computer Interfaces, DOI DOI 10.1007/978-3-642-29746-5_10
[9]   EEG-based detection of emotional valence towards a reproducible measurement of emotions [J].
Apicella, Andrea ;
Arpaia, Pasquale ;
Mastrati, Giovanna ;
Moccaldi, Nicola .
SCIENTIFIC REPORTS, 2021, 11 (01)
[10]   Non-immersive Versus Immersive Extended Reality for Motor Imagery Neurofeedback Within a Brain-Computer Interfaces [J].
Arpaia, Pasquale ;
Coyle, Damien ;
Donnarumma, Francesco ;
Esposito, Antonio ;
Natalizio, Angela ;
Parvis, Marco .
EXTENDED REALITY, XR SALENTO 2022, PT II, 2022, 13446 :407-419