A multiplayer online car racing virtual-reality game based on internet of brains

被引:20
作者
Yeh Shih-Ching [1 ]
Hou, Chung-Lin [2 ]
Peng, Wei-Hao [2 ]
Wei, Zhen-Zhan [2 ]
Huang Shiuan [2 ]
Kung, Edward Yu-Chen [3 ]
Lin, Longsong [3 ]
Liu Yi-Hung [2 ]
机构
[1] Fudan Univ, Sch Informat Sci & Technol, Shanghai, Peoples R China
[2] NTUT, Dept Mech Engn, Taipei 106, Taiwan
[3] Lenovo Global Technol Taiwan Ltd, Taipei, Taiwan
关键词
Brain-computer interface; Virtual reality; EEG; Mental arithmetic; Concentration; Car racing game; COMPUTER INTERFACES; MOTOR IMAGERY; ELECTROENCEPHALOGRAM; COMMUNICATION;
D O I
10.1016/j.sysarc.2018.06.004
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Development of brain-computer interface (BCI)-controlled virtual reality (VR) games has received increasing attention. Yet, the up-to-date BCI-VR systems were still based on one single BCI and a virtual environment (VE). In this paper, we propose and implement a novel BCI-controlled VR (BCI-VR) game based on a structure of internet of brains (IoB) allowing multiple players from different sites to play a car racing game online. Electroencephalographic (EEG) and electromyographic (EMG) signals from different sites' BCIs are uploaded to a high-performance cloud server where the car-controlled algorithms are performed. During the online car racing period, the players mentally control the speeds of their chosen cars by means of concentration, and the concentration level can be adjusted by performing a mental arithmetic (MA) task with different levels of difficulty. Two linear and two nonlinear EEG features, including theta band power (BP), beta BP, Higuchi's fractal dimension (HFD), and Katz's FD (KFD), are used to transform the concentration level to speeds of four different cars. The players can also sensitively trigger the car in the VE to jump by performing a slight teeth-gritting task to generate easy-to-detect EMG signals. Six subjects participated in this study to test the performance of the proposed hybrid (EEG plus EMG) BCI-VR car racing game. The results indicate that theta BP and HFD are more sensitive to the MA-induced concentration in comparison with beta BP and KFD. Through the test of online car racing game, the results also demonstrated the feasibility that different players play the game in the same VE through multiple BCI control at different sites. More importantly, our BCI-VR implementation has a high usability (only two electrodes are required; calibration needs only 64 s) and high feasibility (high average scores of the control, sensory, and distraction factors in a 30-item post-experimental presence questionnaire).
引用
收藏
页码:30 / 40
页数:11
相关论文
共 38 条
[1]  
[Anonymous], 2011, P HUMAN FACTORS ERGO, DOI [10.1177/1071181311551279, DOI 10.1177/1071181311551279]
[2]  
[Anonymous], 2011, AUST J BASIC APPL SC
[3]  
[Anonymous], 2017, THESIS
[4]   3D graphics, virtual reality, and motion-onset visual evoked potentials in neurogaming [J].
Beveridge, R. ;
Wilson, S. ;
Coyle, D. .
BRAIN-COMPUTER INTERFACES: LAB EXPERIMENTS TO REAL-WORLD APPLICATIONS, 2016, 228 :329-353
[5]   Resting electroencephalogram in attention deficit hyperactivity disorder: Developmental course and diagnostic value [J].
Buyck, Inez ;
Wiersema, Jan R. .
PSYCHIATRY RESEARCH, 2014, 216 (03) :391-397
[6]   Mental workload and neural efficiency quantified in the prefrontal cortex using fNIRS [J].
Causse, Mickael ;
Chua, Zarrin ;
Peysakhovich, Vsevolod ;
Del Campo, Natalia ;
Matton, Nadine .
SCIENTIFIC REPORTS, 2017, 7
[7]   Cognitive Workload Assessment Based on the Tensorial Treatment of EEG Estimates of Cross-Frequency Phase Interactions [J].
Dimitriadis, Stavros I. ;
Sun, Yu ;
Kwok, Kenneth ;
Laskaris, Nikolaos A. ;
Thakor, Nitish ;
Bezerianos, Anastasios .
ANNALS OF BIOMEDICAL ENGINEERING, 2015, 43 (04) :977-989
[8]   A comparison of waveform fractal dimension algorithms [J].
Esteller, R ;
Vachtsevanos, G ;
Echauz, J ;
Litt, B .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2001, 48 (02) :177-183
[9]  
Faller J., 2017, A Feasibility Study on SSVEP-Based Interaction with Motivating and Immersive Virtual and Augmented Reality
[10]   TALKING OFF THE TOP OF YOUR HEAD - TOWARD A MENTAL PROSTHESIS UTILIZING EVENT-RELATED BRAIN POTENTIALS [J].
FARWELL, LA ;
DONCHIN, E .
ELECTROENCEPHALOGRAPHY AND CLINICAL NEUROPHYSIOLOGY, 1988, 70 (06) :510-523