Classification of image encoded SSVEP-based EEG signals using Convolutional Neural Networks

被引:9
作者
de Paula, Patrick Oliveira [1 ]
da Silva Costa, Thiago Bulhoes [1 ]
de Faissol Attux, Romis Ribeiro [2 ]
Fantinato, Denis Gustavo [2 ]
机构
[1] Fed Univ ABC, Ctr Math Comp & Cognit CMCC, Santo Andre, SP, Brazil
[2] Univ Estadual Campinas, Sch Elect & Comp Engn FEEC, Campinas, SP, Brazil
基金
巴西圣保罗研究基金会;
关键词
Brain-Computer Interfaces; Convolutional Neural Networks; Deep Learning;
D O I
10.1016/j.eswa.2022.119096
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Brain-Computer Interfaces (BCI) systems based on electroencephalography (EEG) signals are experiencing a rapid development, counting with a number of methods, mainly from signal processing and machine learning areas. Although important results have been achieved, a robust performance is still a very challenging task, mainly considering high intra- and inter-subject variability in EEG data and long acquisition time intervals. Recently, Deep Learning methods, such as the Convolutional Neural Networks (CNNs), are being used in BCI systems in search of a performance improvement. However, the straightforward use of EEG data, without any processing step, may limit the full potential of 2D-kernels in CNNs. In light of this, in this work, we consider for classification with 2D-kernel-based CNNs the problem of encoding EEG data to images as a pre-processing stage, which includes the Gramian Angular Difference and Summation Fields, Markov Transition Fields and Recurrence Plots. Additionally, a comparative analysis using a selection of CNNs is performed. Results show a favorable performance for the proposed method, pointing towards a robust BCI system using cross-subject data, with short acquisition time interval.
引用
收藏
页数:11
相关论文
共 54 条
  • [41] Simonyan K, 2015, Arxiv, DOI arXiv:1409.1556
  • [42] Szegedy C, 2015, IEEE C COMPUTER VISI, DOI DOI 10.1109/CVPR.2015.7298594
  • [43] Tello RMG, 2014, ISSNIP BIOSIG BIOROB, P7
  • [44] Thomas J, 2017, IEEE SYS MAN CYBERN, P234, DOI 10.1109/SMC.2017.8122608
  • [45] Wan ZT, 2021, NEUROCOMPUTING, V421, P1
  • [46] Wang ZG, 2015, PROCEEDINGS OF THE TWENTY-FOURTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI), P3939
  • [47] Compact convolutional neural networks for classification of asynchronous steady-state visual evoked potentials
    Waytowich, Nicholas
    Lawhern, Vernon J.
    Garcia, Javier O.
    Cummings, Jennifer
    Faller, Josef
    Sajda, Paul
    Vettel, Jean M.
    [J]. JOURNAL OF NEURAL ENGINEERING, 2018, 15 (06)
  • [48] Xing J., 2020, NEUROCOMPUTING
  • [49] Sensor Classification Using Convolutional Neural Network by Encoding Multivariate Time Series as Two-Dimensional Colored Images
    Yang, Chao-Lung
    Chen, Zhi-Xuan
    Yang, Chen-Yi
    [J]. SENSORS, 2020, 20 (01)
  • [50] Automated Detection of Myocardial Infarction Using a Gramian Angular Field and Principal Component Analysis Network
    Zhang, Gong
    Si, Yujuan
    Wang, Di
    Yang, Weiyi
    Sun, Yongjian
    [J]. IEEE ACCESS, 2019, 7 : 171570 - 171583