Virtual and Actual Humanoid Robot Control with Four-Class Motor-Imagery-Based Optical Brain-Computer Interface

被引:28
作者
Batula, Alyssa M. [1 ]
Kim, Youngmoo E. [1 ]
Ayaz, Hasan [2 ,3 ,4 ]
机构
[1] Drexel Univ, Dept Elect & Comp Engn, 3141 Chestnut St, Philadelphia, PA 19104 USA
[2] Drexel Univ, Sch Biomed Engn Sci & Hlth Syst, 3141 Chestnut St, Philadelphia, PA 19104 USA
[3] Univ Penn, Dept Family & Community Hlth, 3737 Market St, Philadelphia, PA 19104 USA
[4] Childrens Hosp Philadelphia, Div Gen Pediat, 3401 Civ Ctr Blvd, Philadelphia, PA 19104 USA
基金
美国国家科学基金会;
关键词
NEAR-INFRARED SPECTROSCOPY; CLASSIFICATION; MACHINE; EXECUTION; SIGNALS; TASK;
D O I
10.1155/2017/1463512
中图分类号
Q81 [生物工程学(生物技术)]; Q93 [微生物学];
学科分类号
071005 ; 0836 ; 090102 ; 100705 ;
摘要
Motor-imagery tasks are a popular input method for controlling brain-computer interfaces (BCIs), partially due to their similarities to naturally produced motor signals. The use of functional near-infrared spectroscopy (fNIRS) in BCIs is still emerging and has shown potential as a supplement or replacement for electroencephalography. However, studies often use only two or three motorimagery tasks, limiting the number of available commands. In thiswork, we present the results of the first four-class motor-imagerybased online fNIRS-BCI for robot control. Thirteen participants utilized upper-and lower-limb motor-imagery tasks (left hand, right hand, left foot, and right foot) that were mapped to four high-level commands (turn left, turn right, move forward, and move backward) to control the navigation of a simulated or real robot. A significant improvement in classification accuracy was found between the virtual-robot-based BCI (control of a virtual robot) and the physical-robot BCI (control of the DARwIn-OP humanoid robot). Differences were also found in the oxygenated hemoglobin activation patterns of the four tasks between the first and second BCI. These results corroborate previous findings that motor imagery can be improved with feedback and imply that a four-class motor-imagery-based fNIRS-BCI could be feasible with sufficient subject training.
引用
收藏
页数:13
相关论文
共 69 条
[1]   Large-Scale Assessment of a Fully Automatic Co-Adaptive Motor Imagery-Based Brain Computer Interface [J].
Acqualagna, Laura ;
Botrel, Loic ;
Vidaurre, Carmen ;
Kuebler, Andrea ;
Blankertz, Benjamin .
PLOS ONE, 2016, 11 (02)
[2]   Performance variation in motor imagery brain-computer interface: A brief review [J].
Ahn, Minkyu ;
Jun, Sung Chan .
JOURNAL OF NEUROSCIENCE METHODS, 2015, 243 :103-110
[3]   A Brain-Machine Interface to Navigate a Mobile Robot in a Planar Workspace: Enabling Humans to Fly Simulated Aircraft With EEG [J].
Akce, Abdullah ;
Johnson, Miles ;
Dantsker, Or ;
Bretl, Timothy .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2013, 21 (02) :306-318
[4]   The Importance of Visual Feedback Design in BCIs; from Embodiment to Motor Imagery Learning [J].
Alimardani, Maryam ;
Nishio, Shuichi ;
Ishiguro, Hiroshi .
PLOS ONE, 2016, 11 (09)
[5]  
[Anonymous], 2015, IEEE SPECTRUM, V52, P11
[6]   Maze Suite 1.0: A complete set of tools to prepare, present, and analyze navigational and spatial cognitive neuroscience experiments [J].
Ayaz, Hasan ;
Allen, Sarah L. ;
Platek, Steven M. ;
Onaral, Banu .
BEHAVIOR RESEARCH METHODS, 2008, 40 (01) :353-359
[7]   Continuous monitoring of brain dynamics with functional near infrared spectroscopy as a tool for neuroergonomic research: empirical examples and a technological development [J].
Ayaz, Hasan ;
Onaral, Banu ;
Izzetoglu, Kurtulus ;
Shewokis, Patricia A. ;
McKendrick, Ryan ;
Parasuraman, Raja .
FRONTIERS IN HUMAN NEUROSCIENCE, 2013, 7
[8]   Using MazeSuite and Functional Near Infrared Spectroscopy to Study Learning in Spatial Navigation [J].
Ayaz, Hasan ;
Shewokis, Patricia A. ;
Curtin, Adrian ;
Izzetoglu, Meltem ;
Izzetoglu, Kurtulus ;
Onaral, Banu .
JOVE-JOURNAL OF VISUALIZED EXPERIMENTS, 2011, (56)
[9]   Activation of a Mobile Robot through a Brain Computer Interface [J].
Barbosa, Alexandre O. G. ;
Achanccaray, David R. ;
Meggiolaro, Marco A. .
2010 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2010, :4815-4821
[10]   Comparison of Brain Activation during Motor Imagery and Motor Movement Using fNIRS [J].
Batula, Alyssa M. ;
Mark, Jesse A. ;
Kim, Youngmoo E. ;
Ayaz, Hasan .
COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2017, 2017