Hybrid Brain-Computer interface Techniques for improved Classification Accuracy and increased Number of Commands: A Review

被引:178
作者
Hong, Keum-Shik [1 ,2 ]
Khan, Muhammad Jawad [1 ]
机构
[1] Pusan Natl Univ, Sch Mech Engn, Busan, South Korea
[2] Pusan Natl Univ, Dept Cogno Mechatron Engn, Busan, South Korea
基金
新加坡国家研究基金会;
关键词
hybrid brain-computer interface; functional near infrared spectroscopy; electroencephalography; electrooculography; electromyography; classification accuracy; NEAR-INFRARED SPECTROSCOPY; DIRECT-CURRENT STIMULATION; INDEPENDENT COMPONENT ANALYSIS; 2-D CURSOR CONTROL; MOTOR IMAGERY; MENTAL FATIGUE; BCI SYSTEM; HEMODYNAMIC-RESPONSES; FEATURE-EXTRACTION; OCULAR ARTIFACTS;
D O I
10.3389/fnbot.2017.00035
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this article, non-invasive hybrid brain-computer interface (hBCI) technologies for improving classification accuracy and increasing the number of commands are reviewed. Hybridization combining more than two modalities is a new trend in brain imaging and prosthesis control. Electroencephalography (EEG), due to its easy use and fast temporal resolution, is most widely utilized in combination with other brain/ non-brain signal acquisition modalities, for instance, functional near infrared spectroscopy (fNIRS), electromyography (EMG), electrooculography (EOG), and eye tracker. Three main purposes of hybridization are to increase the number of control commands, improve classification accuracy and reduce the signal detection time. Currently, such combinations of EEG + fNIRS and EEG + EOG are most commonly employed. Four principal components (i.e., hardware, paradigm, classifiers, and features) relevant to accuracy improvement are discussed. In the case of brain signals, motor imagination/movement tasks are combined with cognitive tasks to increase active brain-computer interface (BCI) accuracy. Active and reactive tasks sometimes are combined: motor imagination with steady-state evoked visual potentials (SSVEP) and motor imagination with P300. In the case of reactive tasks, SSVEP is most widely combined with P300 to increase the number of commands. Passive BCIs, however, are rare. After discussing the hardware and strategies involved in the development of hBCI, the second part examines the approaches used to increase the number of control commands and to enhance classification accuracy. The future prospects and the extension of hBCI in real-time applications for daily life scenarios are provided.
引用
收藏
页数:27
相关论文
共 235 条
[1]   Performance variation in motor imagery brain-computer interface: A brief review [J].
Ahn, Minkyu ;
Jun, Sung Chan .
JOURNAL OF NEUROSCIENCE METHODS, 2015, 243 :103-110
[2]   A Review of Brain-Computer Interface Games and an Opinion Survey from Researchers, Developers and Users [J].
Ahn, Minkyu ;
Lee, Mijin ;
Choi, Jinyoung ;
Jun, Sung Chan .
SENSORS, 2014, 14 (08) :14601-14633
[3]   Exploring Neuro-Physiological Correlates of Drivers' Mental Fatigue Caused by Sleep Deprivation Using Simultaneous EEG, ECG, and fNIRS Data [J].
Ahn, Sangtae ;
Nguyen, Thien ;
Jang, Hyojung ;
Kim, Jae G. ;
Jun, Sung C. .
FRONTIERS IN HUMAN NEUROSCIENCE, 2016, 10
[4]   Having to stop driving at night because of dangerous sleepiness - awareness, physiology and behaviour [J].
Akerstedt, Torbjorn ;
Hallvig, David ;
Anund, Anna ;
Fors, Carina ;
Schwarz, Johanna ;
Kecklund, Goran .
JOURNAL OF SLEEP RESEARCH, 2013, 22 (04) :380-388
[5]   Toward a hybrid brain-computer interface based on imagined movement and visual attention [J].
Allison, B. Z. ;
Brunner, C. ;
Kaiser, V. ;
Mueller-Putz, G. R. ;
Neuper, C. ;
Pfurtscheller, G. .
JOURNAL OF NEURAL ENGINEERING, 2010, 7 (02)
[6]   A four-choice hybrid P300/SSVEP BCI for improved accuracy [J].
Allison, Brendan Z. ;
Jin, Jing ;
Zhang, Yu ;
Wang, Xingyu .
BRAIN-COMPUTER INTERFACES, 2014, 1 (01) :17-26
[7]   Exploring Combinations of Auditory and Visual Stimuli for Gaze-Independent Brain-Computer Interfaces (vol 9, e111070, 2014) [J].
An, X. ;
Hohne, J. ;
Ming, D. ;
Blankertz, B. .
PLOS ONE, 2016, 11 (06)
[8]   Hemodynamic Correlates of Cognition in Human Infants [J].
Aslin, Richard N. ;
Shukla, Mohinish ;
Emberson, Lauren L. .
ANNUAL REVIEW OF PSYCHOLOGY, VOL 66, 2015, 66 :349-379
[9]   Continuous monitoring of brain dynamics with functional near infrared spectroscopy as a tool for neuroergonomic research: empirical examples and a technological development [J].
Ayaz, Hasan ;
Onaral, Banu ;
Izzetoglu, Kurtulus ;
Shewokis, Patricia A. ;
McKendrick, Ryan ;
Parasuraman, Raja .
FRONTIERS IN HUMAN NEUROSCIENCE, 2013, 7
[10]   Optical brain monitoring for operator training and mental workload assessment [J].
Ayaz, Hasan ;
Shewokis, Patricia A. ;
Bunce, Scott ;
Izzetoglu, Kurtulus ;
Willems, Ben ;
Onaral, Banu .
NEUROIMAGE, 2012, 59 (01) :36-47