Enhanced Performance of a Brain Switch by Simultaneous Use of EEG and NIRS Data for Asynchronous Brain-Computer Interface

被引:35
作者
Han, Chang-Hee [1 ]
Muller, Klaus-Robert [1 ,2 ,3 ]
Hwang, Han-Jeong [4 ]
机构
[1] Tech Univ Berlin, Machine Learning Grp, D-10587 Berlin, Germany
[2] Korea Univ, Dept Brain & Cognit Engn, Seoul 136713, South Korea
[3] Max Planck Inst Informat, D-66123 Saarbrucken, Germany
[4] Korea Univ, Dept Elect & Informat Engn, Sejong 30019, South Korea
基金
新加坡国家研究基金会;
关键词
Switches; Electroencephalography; Task analysis; Band-pass filters; Feature extraction; Brain; Brain-computer interface (BCI); electroencephalography (EEG); near-infrared spectroscopy (NIRS); brain switch; onset detection; MOTOR IMAGERY; NEURAL-NETWORKS; SET-UP; BCI; CLASSIFICATION; SYSTEM; ORTHOSIS;
D O I
10.1109/TNSRE.2020.3017167
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Previous studies have shown the superior performance of hybrid electroencephalography (EEG)/ near-infrared spectroscopy (NIRS) brain-computer interfaces (BCIs). However, it has been veiled whether the use of a hybrid EEG/NIRS modality can provide better performance for a brain switch that can detect the onset of the intention to turn on a BCI. In this study, we developed such a hybrid EEG/NIRS brain switch and compared its performance with single modality EEG- and NIRS-based brain switch respectively, in terms of true positive rate (TPR), false positive rate (FPR), onset detection time (ODT), and information transfer rate (ITR). In an offline analysis, the performance of a hybrid EEG/NIRS brain switch was significantly improved over that of EEG- and NIRS-based brain switches in general, and in particular a significantly lower FPR was observed for the hybrid EEG/NIRS brain switch. A pseudo-online analysis was additionally performed to confirm the feasibility of implementing an online BCI system with our hybrid EEG/NIRS brain switch. The overall trend of pseudo-online analysis results generally coincided with that of the offline analysis results. No significant difference in all performance measures was also found between offline and pseudo online analysis schemes when the amount of training data was same, with one exception for the ITRs of an EEG brain switch. These offline and pseudo-online results demonstrate that a hybrid EEG/NIRS brain switch can be used to provide a better onset detection performance than that of a single neuroimaging modality.
引用
收藏
页码:2102 / 2112
页数:11
相关论文
共 89 条
[1]  
[Anonymous], 2007, BRAIN COMPUTER INTER
[2]  
Barachant A., 2011, P 5 INT BRAIN COMP I, P64
[3]   Development, set-up and first results for a one-channel near-infrared spectroscopy system [J].
Bauernfeind, Guenther ;
Leeb, Robert ;
Wriessnegger, Selina Christin ;
Pfurtscheller, Gert .
BIOMEDIZINISCHE TECHNIK, 2008, 53 (01) :36-43
[4]   Single-trial classification of antagonistic oxyhemoglobin responses during mental arithmetic [J].
Bauernfeind, Guenther ;
Scherer, Reinhold ;
Pfurtscheller, Gert ;
Neuper, Christa .
MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2011, 49 (09) :979-984
[5]  
Blankertz B, 2002, ADV NEUR IN, V14, P157
[6]   Boosting bit rates and error detection for the classification of fast-paced motor commands based on single-trial EEG analysis [J].
Blankertz, B ;
Dornhege, G ;
Schäfer, C ;
Krepki, R ;
Kohlmorgen, J ;
Müller, KR ;
Kunzmann, V ;
Losch, F ;
Curio, G .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2003, 11 (02) :127-131
[7]   Optimizing spatial filters for robust EEG single-trial analysis [J].
Blankertz, Benjamin ;
Tomioka, Ryota ;
Lemm, Steven ;
Kawanabe, Motoaki ;
Mueller, Klaus-Robert .
IEEE SIGNAL PROCESSING MAGAZINE, 2008, 25 (01) :41-56
[8]   The non-invasive Berlin Brain-Computer Interface:: Fast acquisition of effective performance in untrained subjects [J].
Blankertz, Benjamin ;
Dornhege, Guido ;
Krauledat, Matthias ;
Mueller, Klaus-Robert ;
Curio, Gabriel .
NEUROIMAGE, 2007, 37 (02) :539-550
[9]   The Berlin Brain-Computer Interface: Progress Beyond Communication and Control [J].
Blankertz, Benjamin ;
Acqualagna, Laura ;
Dahne, Sven ;
Haufe, Stefan ;
-Kraft, Matthias Schultze ;
Sturm, Irene ;
Uscumlic, Marija ;
Wenzel, Markus A. ;
Curio, Gabriel ;
Muller, Klaus -Robert .
FRONTIERS IN NEUROSCIENCE, 2016, 10
[10]   Neurophysiological predictor of SMR-based BCI performance [J].
Blankertz, Benjamin ;
Sannelli, Claudia ;
Haider, Sebastian ;
Hammer, Eva M. ;
Kuebler, Andrea ;
Mueller, Klaus-Robert ;
Curio, Gabriel ;
Dickhaus, Thorsten .
NEUROIMAGE, 2010, 51 (04) :1303-1309