Enhancing brain-machine interface (BMI) control of a hand exoskeleton using electrooculography (EOG)

被引:61
作者
Witkowski, Matthias [1 ,2 ]
Cortese, Mario [3 ]
Cempini, Marco [3 ]
Mellinger, Juergen [1 ,2 ]
Vitiello, Nicola [3 ,4 ]
Soekadar, Surjo R. [1 ,2 ]
机构
[1] Univ Tubingen Hosp, Dept Psychiat & Psychotherapy, Appl Neurotechnol Lab, D-72076 Tubingen, Germany
[2] Univ Tubingen, Inst Med Psychol & Behav Neurobiol, D-72076 Tubingen, Germany
[3] Scuola Super Sant Anna, BioRobot Inst, Pisa, Italy
[4] Ctr Florence, Fdn Don Carlo Gnocchi, I-50143 Florence, Italy
关键词
Brain-machine interface (BMI); Hand exoskeleton control; Electrooculography (EOG); Safety; CLASSIFICATION;
D O I
10.1186/1743-0003-11-165
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Background: Brain-machine interfaces (BMIs) allow direct translation of electric, magnetic or metabolic brain signals into control commands of external devices such as robots, prostheses or exoskeletons. However, non-stationarity of brain signals and susceptibility to biological or environmental artifacts impede reliable control and safety of BMIs, particularly in daily life environments. Here we introduce and tested a novel hybrid brain-neural computer interaction (BNCI) system fusing electroencephalography (EEG) and electrooculography (EOG) to enhance reliability and safety of continuous hand exoskeleton-driven grasping motions. Findings: 12 healthy volunteers (8 male, mean age 28.1 +/- 3.63y) used EEG (condition #1) and hybrid EEG/EOG (condition #2) signals to control a hand exoskeleton. Motor imagery-related brain activity was translated into exoskeleton-driven hand closing motions. Unintended motions could be interrupted by eye movement-related EOG signals. In order to evaluate BNCI control and safety, participants were instructed to follow a visual cue indicating either to move or not to move the hand exoskeleton in a random order. Movements exceeding 25% of a full grasping motion when the device was not supposed to be moved were defined as safety violation. While participants reached comparable control under both conditions, safety was frequently violated under condition #1 (EEG), but not under condition #2 (EEG/EOG). Conclusion: EEG/EOG biosignal fusion can substantially enhance safety of assistive BNCI systems improving their applicability in daily life environments.
引用
收藏
页数:6
相关论文
共 18 条
[1]   Multiclass Brain-Computer Interface Classification by Riemannian Geometry [J].
Barachant, Alexandre ;
Bonnet, Stephane ;
Congedo, Marco ;
Jutten, Christian .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2012, 59 (04) :920-928
[2]   Boosting bit rates and error detection for the classification of fast-paced motor commands based on single-trial EEG analysis [J].
Blankertz, B ;
Dornhege, G ;
Schäfer, C ;
Krepki, R ;
Kohlmorgen, J ;
Müller, KR ;
Kunzmann, V ;
Losch, F ;
Curio, G .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2003, 11 (02) :127-131
[3]   A Powered Finger-Thumb Wearable Hand Exoskeleton With Self-Aligning Joint Axes [J].
Cempini, Marco ;
Cortese, Mario ;
Vitiello, Nicola .
IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2015, 20 (02) :705-716
[4]   Current Challenges to the Clinical Translation of Brain Machine Interface Technology [J].
Lu, Charles W. ;
Patil, Parag G. ;
Chestek, Cynthia A. .
EMERGING HORIZONS IN NEUROMODULATION: NEW FRONTIERS IN BRAIN AND SPINE STIMULATION, 2012, 107 :137-160
[5]   BCI Meeting 2005 -: Workshop on BCI signal processing:: Feature extraction and translation [J].
McFarland, Dennis J. ;
Anderson, Charles W. ;
Mueller, Klaus-Robert ;
Schloegl, Alois ;
Krusienski, Dean J. .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2006, 14 (02) :135-138
[6]   Combining brain-computer interfaces and assistive technologies: state-of-the-art and challenges [J].
Millan, J. D. R. ;
Rupp, R. ;
Mueller-Putz, G. R. ;
Murray-Smith, R. ;
Giugliemma, C. ;
Tangermann, M. ;
Vidaurre, C. ;
Cincotti, F. ;
Kubler, A. ;
Leeb, R. ;
Neuper, C. ;
Mueller, K. -R. ;
Mattia, D. .
FRONTIERS IN NEUROSCIENCE, 2010, 4
[7]   THE ASSESSMENT AND ANALYSIS OF HANDEDNESS: THE EDINBURGH INVENTORY [J].
OLDFIELD, RC .
NEUROPSYCHOLOGIA, 1971, 9 (01) :97-113
[8]   EVALUATION OF EVENT-RELATED DESYNCHRONIZATION (ERD) PRECEDING AND FOLLOWING VOLUNTARY SELF-PACED MOVEMENT [J].
PFURTSCHELLER, G ;
ARANIBAR, A .
ELECTROENCEPHALOGRAPHY AND CLINICAL NEUROPHYSIOLOGY, 1979, 46 (02) :138-146
[9]   Self-Paced Operation of an SSVEP-Based Orthosis With and Without an Imagery-Based "Brain Switch:" A Feasibility Study Towards a Hybrid BCI [J].
Pfurtscheller, Gert ;
Solis-Escalante, Teodoro ;
Ortner, Rupert ;
Linortner, Patricia ;
Mueller-Putz, Gernot R. .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2010, 18 (04) :409-414
[10]   Hybrid EEG-EOG Brain-Computer Interface System for Practical Machine Control [J].
Punsawad, Yunyong ;
Wongsawat, Yodchanan ;
Parnichkun, Manukid .
2010 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2010, :1360-1363