Ensemble Learning Based Brain-Computer Interface System for Ground Vehicle Control

被引:28
作者
Zhuang, Jiayu [1 ]
Geng, Keke [1 ]
Yin, Guodong [1 ]
机构
[1] Southeast Univ, Sch Mech Engn, Nanjing 211189, Peoples R China
来源
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS | 2021年 / 51卷 / 09期
基金
中国国家自然科学基金;
关键词
Electroencephalography; Feature extraction; Land vehicles; Testing; Training; Electrodes; Brain-computer interface (BCI); convolutional neural networks (CNN); electroencephalograph (EEG); ensemble learning; shared control; vehicle motion control; MOTOR IMAGERY; EEG; CLASSIFICATION; ARTIFACTS; REMOVAL; FILTERS; LEVEL; MODE; P300; SVM;
D O I
10.1109/TSMC.2019.2955478
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article establishes a novel electroencephalograph (EEG)-based brain-computer interface (BCI) system for ground vehicle control with potential application of mobility assistance to the disabled. To enable an intuitive motor imagery (MI) paradigm of "left," "right," "push," and "pull," a driving simulator based EEG data recording and automatic labeling platform is built for dataset making. In the preprocessing stage, a wavelet and canonical correlation analysis (CCA) combined method is used for artifact removal and improving signal-to-noise ratio. An ensemble learning based training and testing framework is proposed for MI EEG data classification. The average classification accuracy of proposed framework is about 91.75%. This approach essentially takes advantage of the common spatial pattern (CSP) with ability of extracting the feature of event-related potentials and the convolutional neural networks (CNNs) with powerful capacity of feature learning and classification. To convert the classification results of EEG data segments into motion control signals of ground vehicle, shared control strategy is used to realize the control command of "left-steering," "right-steering," "acceleration," and "stop" considering collision avoidance with obstacles detected by a single-line LIDAR. The online experimental results on a model vehicle platform validate the significant performance of the established BCI system and reveal the application potential of BCI on the vehicle control and automation.
引用
收藏
页码:5392 / 5404
页数:13
相关论文
共 55 条
[1]   Optimizing Spatial Filters by Minimizing Within-Class Dissimilarities in Electroencephalogram-Based Brain-Computer Interface [J].
Arvaneh, Mahnaz ;
Guan, Cuntai ;
Ang, Kai Keng ;
Quek, Chai .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2013, 24 (04) :610-619
[2]   Validation of the Emotiv EPOC EEG system for research quality auditory event-related potentials in children [J].
Badcock, Nicholas A. ;
Preece, Kathryn A. ;
de Wit, Bianca ;
Glenn, Katharine ;
Fieder, Nora ;
Thie, Johnson ;
McArthur, Genevieve .
PEERJ, 2015, 3
[3]   A Synergetic Brain-Machine Interfacing Paradigm for Multi-DOF Robot Control [J].
Bhattacharyya, Saugat ;
Shimoda, Shingo ;
Hayashibe, Mitsuhiro .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2016, 46 (07) :957-968
[4]   Motor imagery, P300 and error-related EEG-based robot arm movement control for rehabilitation purpose [J].
Bhattacharyya, Saugat ;
Konar, Amit ;
Tibarewala, D. N. .
MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2014, 52 (12) :1007-1017
[5]   A differential evolution based energy trajectory planner for artificial limb control using motor imagery EEG signal [J].
Bhattacharyya, Saugat ;
Konar, Amit ;
Tibarewala, D. N. .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2014, 11 :107-113
[6]   A Novel Method of Emergency Situation Detection for a Brain-Controlled Vehicle by Combining EEG Signals With Surrounding Information [J].
Bi, Luzheng ;
Wang, Huikang ;
Teng, Teng ;
Guan, Cuntai .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2018, 26 (10) :1926-1934
[7]   A spelling device for the paralysed [J].
Birbaumer, N ;
Ghanayim, N ;
Hinterberger, T ;
Iversen, I ;
Kotchoubey, B ;
Kübler, A ;
Perelmouter, J ;
Taub, E ;
Flor, H .
NATURE, 1999, 398 (6725) :297-298
[8]   Control of a vehicle with EEG signals in real-time and system evaluation [J].
Choi, Kyuwan .
EUROPEAN JOURNAL OF APPLIED PHYSIOLOGY, 2012, 112 (02) :755-766
[9]   Projected Accuracy Metric for the P300 Speller [J].
Colwell, Kenneth ;
Throckmorton, Chandra ;
Collins, Leslie ;
Morton, Kenneth, Jr. .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2014, 22 (05) :921-925
[10]   EEG-based discrimination between imagination of left and right hand movements using adaptive gaussian representation [J].
Costa, EJX ;
Cabral, EF .
MEDICAL ENGINEERING & PHYSICS, 2000, 22 (05) :345-348