Convolutional neural network and riemannian geometry hybrid approach for motor imagery classification

被引:27
作者
Gao, Chang [1 ]
Liu, Wenchao [1 ]
Yang, Xian [1 ]
机构
[1] Yanshan Univ, Sch Informat Sci & Engn, Qinhuangdao, Peoples R China
关键词
Brain-computer interface; Motion imagery; Convolution neural network; Riemannian manifold; EEG; COMMON SPATIAL-PATTERN; BRAIN-COMPUTER INTERFACES; EEG;
D O I
10.1016/j.neucom.2022.08.024
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The electroencephalogram (EEG) signal is commonly applied in the brain-computer interface (BCI) system of the motor imagery paradigm because it is noninvasive and has a high time resolution. This paper proposes a motor imagery classification method based on convolutional neural networks and Riemannian geometry to overcome the problem of noise and extreme values impacting motor imagery classification performance. The time-domain properties of EEG signals are extracted using multiscale temporal convolutions, whereas the spatial aspects of EEG signals are extracted using multiple convolutional kernels learned by spatial convolution. The extracted features are mapped to a Riemannian manifold space, and bilinear mapping and logarithmic operations are performed on the features to solve the problem of noise and extreme values. The effectiveness of the proposed method is validated using four types of motor imagery in the BCI competition IV dataset 2a to evaluate the classification ability. The experimental results show that the proposed approach has obvious advantages in the classification performance of motor imagery. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:180 / 190
页数:11
相关论文
共 33 条
[1]  
Absil PA, 2008, OPTIMIZATION ALGORITHMS ON MATRIX MANIFOLDS, P1
[2]   Deep Learning for EEG motor imagery classification based on multi-layer CNNs feature fusion [J].
Amin, Syed Umar ;
Alsulaiman, Mansour ;
Muhammad, Ghulam ;
Mekhtiche, Mohamed Amine ;
Hossain, M. Shamim .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 101 :542-554
[3]  
Ang KK, 2008, IEEE IJCNN, P2390, DOI 10.1109/IJCNN.2008.4634130
[4]   Multiclass Brain-Computer Interface Classification by Riemannian Geometry [J].
Barachant, Alexandre ;
Bonnet, Stephane ;
Congedo, Marco ;
Jutten, Christian .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2012, 59 (04) :920-928
[5]   Optimizing spatial filters for robust EEG single-trial analysis [J].
Blankertz, Benjamin ;
Tomioka, Ryota ;
Lemm, Steven ;
Kawanabe, Motoaki ;
Mueller, Klaus-Robert .
IEEE SIGNAL PROCESSING MAGAZINE, 2008, 25 (01) :41-56
[6]  
Brunner C., 2008, Inst. Knowl. Discov. (Lab Brain-Comput. Interfaces), Graz Univ. Technol., V16, P1
[7]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[8]   Advanced TSGL-EEGNet for Motor Imagery EEG-Based Brain-Computer Interfaces [J].
Deng, Xin ;
Zhang, Boxian ;
Yu, Nian ;
Liu, Ke ;
Sun, Kaiwei .
IEEE ACCESS, 2021, 9 (09) :25118-25130
[9]  
Huang ZW, 2017, AAAI CONF ARTIF INTE, P2036
[10]   A novel multi-modal machine learning based approach for automatic classification of EEG recordings in dementia [J].
Ieracitano, Cosimo ;
Mammone, Nadia ;
Hussain, Amir ;
Morabito, Francesco C. .
NEURAL NETWORKS, 2020, 123 :176-190