Brain-Computer Interface Control in a Virtual Reality Environment and Applications for the Internet of Things

被引:101
作者
Coogan, Christopher G. [1 ]
He, Bin [1 ,2 ]
机构
[1] Univ Minnesota, Dept Biomed Engn, Minneapolis, MN 55106 USA
[2] Carnegie Mellon Univ, Dept Biomed Engn, Pittsburgh, PA 15213 USA
基金
美国国家科学基金会; 美国国家卫生研究院;
关键词
Brain computer interface; virtual reality; Internet of Things; Unity; sensorimotor rhythms; STATE;
D O I
10.1109/ACCESS.2018.2809453
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Brain-computer interfaces (BCIs) have enabled individuals to control devices, such as spellers, robotic arms, drones, and wheelchairs, but often these BCI applications are restricted to research laboratories. With the advent of virtual reality (VR) systems and the Internet of Things (IoT) we can couple these technologies to offer real-time control of a users virtual and physical environment. Likewise, BCI applications are often single-use with users having no control outside of the restrictions placed upon the applications at the time of creation. Therefore, there is a need to create a tool that allows users the flexibility to create and modularize aspects of BCI applications for control of IoT devices and VR environments. Using a popular video game engine, Unity, and coupling it with BCI2000, we can create diverse applications that give the end-user additional autonomy during the task at hand. We demonstrate the validity of controlling a Unity-based VR environment and several commercial IoT devices via direct neural interfacing processed through BCI2000.
引用
收藏
页码:10840 / 10849
页数:10
相关论文
共 24 条
[1]   Video game training enhances cognitive control in older adults [J].
Anguera, J. A. ;
Boccanfuso, J. ;
Rintoul, J. L. ;
Al-Hashimi, O. ;
Faraji, F. ;
Janowich, J. ;
Kong, E. ;
Larraburo, Y. ;
Rolle, C. ;
Johnston, E. ;
Gazzaley, A. .
NATURE, 2013, 501 (7465) :97-+
[2]   A virtual reality testbed for brain-computer interface research [J].
Bayliss, JD ;
Ballard, DH .
IEEE TRANSACTIONS ON REHABILITATION ENGINEERING, 2000, 8 (02) :188-190
[3]   Mirror therapy for phantom limb pain [J].
Chan, Brenda L. ;
Witt, Richard ;
Charrow, Alexandra P. ;
Magee, Amanda ;
Howard, Robin ;
Pasquina, Paul F. ;
Heilman, Kenneth M. ;
Tsao, Jack W. .
NEW ENGLAND JOURNAL OF MEDICINE, 2007, 357 (21) :2206-2207
[4]   EEG Source Imaging Enhances the Decoding of Complex Right-Hand Motor Imagery Tasks [J].
Edelman, Bradley J. ;
Baxter, Bryan ;
He, Bin .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2016, 63 (01) :4-14
[5]  
Edlinger G., 2012, PRESENTED COMPLEX ME
[6]   An Application Framework for Controlling an Avatar in a Desktop-Based Virtual Environment via a Software SSVEP Brain-Computer Interface [J].
Faller, Josef ;
Mueller-Putz, Gernot ;
Schmalstieg, Dieter ;
Pfurtscheller, Gert .
PRESENCE-TELEOPERATORS AND VIRTUAL ENVIRONMENTS, 2010, 19 (01) :25-34
[7]  
He B., 2013, Neural Engineering, V2nd, P87
[8]  
He B, 2015, P IEEE, V103, P907, DOI [10.1109/JPROC.2015.2407272, 10.1109/jproc.2015.2407272]
[9]   The Sense of Embodiment in Virtual Reality [J].
Kilteni, Konstantina ;
Groten, Raphaela ;
Slater, Mel .
PRESENCE-TELEOPERATORS AND VIRTUAL ENVIRONMENTS, 2012, 21 (04) :373-387
[10]   Steady-state VEP-based brain-computer interface control in an immersive 3D gaming environment [J].
Lalor, EC ;
Kelly, SP ;
Finucane, C ;
Burke, R ;
Smith, R ;
Reilly, RB ;
McDarby, G .
EURASIP JOURNAL ON APPLIED SIGNAL PROCESSING, 2005, 2005 (19) :3156-3164