Classification of image encoded SSVEP-based EEG signals using Convolutional Neural Networks

被引:9
作者
de Paula, Patrick Oliveira [1 ]
da Silva Costa, Thiago Bulhoes [1 ]
de Faissol Attux, Romis Ribeiro [2 ]
Fantinato, Denis Gustavo [2 ]
机构
[1] Fed Univ ABC, Ctr Math Comp & Cognit CMCC, Santo Andre, SP, Brazil
[2] Univ Estadual Campinas, Sch Elect & Comp Engn FEEC, Campinas, SP, Brazil
基金
巴西圣保罗研究基金会;
关键词
Brain-Computer Interfaces; Convolutional Neural Networks; Deep Learning;
D O I
10.1016/j.eswa.2022.119096
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Brain-Computer Interfaces (BCI) systems based on electroencephalography (EEG) signals are experiencing a rapid development, counting with a number of methods, mainly from signal processing and machine learning areas. Although important results have been achieved, a robust performance is still a very challenging task, mainly considering high intra- and inter-subject variability in EEG data and long acquisition time intervals. Recently, Deep Learning methods, such as the Convolutional Neural Networks (CNNs), are being used in BCI systems in search of a performance improvement. However, the straightforward use of EEG data, without any processing step, may limit the full potential of 2D-kernels in CNNs. In light of this, in this work, we consider for classification with 2D-kernel-based CNNs the problem of encoding EEG data to images as a pre-processing stage, which includes the Gramian Angular Difference and Summation Fields, Markov Transition Fields and Recurrence Plots. Additionally, a comparative analysis using a selection of CNNs is performed. Results show a favorable performance for the proposed method, pointing towards a robust BCI system using cross-subject data, with short acquisition time interval.
引用
收藏
页数:11
相关论文
共 54 条
  • [1] Brain computer interfacing: Applications and challenges
    Abdulkader, Sarah N.
    Atia, Ayman
    Mostafa, Mostafa-Sami M.
    [J]. EGYPTIAN INFORMATICS JOURNAL, 2015, 16 (02) : 213 - 230
  • [2] Aggarwal S, 2022, ARCH COMPUT METHOD E, V29, P3001, DOI 10.1007/s11831-021-09684-6
  • [3] Ang KK, 2008, IEEE IJCNN, P2390, DOI 10.1109/IJCNN.2008.4634130
  • [4] [Anonymous], 1995, WORLD SCI SERIES N A
  • [5] Attia M, 2018, I S BIOMED IMAGING, P766, DOI 10.1109/ISBI.2018.8363685
  • [6] On the Classification of SSVEP-Based Dry-EEG Signals via Convolutional Neural Networks
    Aznan, Nik Khadijah Nik
    Bonner, Stephen
    Connolly, Jason D.
    Al Moubayed, Noura
    Breckon, Toby P.
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2018, : 3726 - 3731
  • [7] Deep learning and time series-to-image encoding for financial forecasting
    Barra, Silvio
    Carta, Salvatore Mario
    Corriga, Andrea
    Podda, Alessandro Sebastian
    Recupero, Diego Reforgiato
    [J]. IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2020, 7 (03) : 683 - 692
  • [8] Bishop C. M., 2007, Pattern Recognition and Machine Learning Information Science and Statistics, V1st
  • [9] Duality between Time Series and Networks
    Campanharo, Andriana S. L. O.
    Sirer, M. Irmak
    Malmgren, R. Dean
    Ramos, Fernando M.
    Amaral, Luis A. Nunes
    [J]. PLOS ONE, 2011, 6 (08):
  • [10] Comparative analysis of strategies for feature extraction and classification in SSVEP BCIs
    Carvalho, Sarah N.
    Costa, Thiago B. S.
    Uribe, Luisa F. S.
    Soriano, Diogo C.
    Yared, Glauco F. G.
    Coradine, Luis C.
    Attux, Romis
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2015, 21 : 34 - 42