EEG-based imagined words classification using Hilbert transform and deep networks

被引:2
作者
Agarwal, Prabhakar [1 ]
Kumar, Sandeep [1 ]
机构
[1] Natl Inst Technol Delhi, Elect & Commun Engn, Plot FA7,Zone P1,GT Karnal Rd, Delhi 110036, India
基金
英国科研创新办公室;
关键词
Brain-computer interface; Convolutional neural network; Electroencephalography; Hilbert transform; Imagined speech classification; EMPIRICAL MODE DECOMPOSITION; COVERT SPEECH;
D O I
10.1007/s11042-023-15664-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The completely paralyzed and quadriplegic patients cannot communicate with others. However, the imagined thoughts of these patients can be used to drive assistive devices by brain-computer interfacing (BCI), the success of which relies on better classification accuracies. In this paper, we have performed an experiment for the classification of imagined words, which can provide an alternative neural path of speech communication for deprived people. A 32-channel industry-standard physiological signal system is used to measure imagined electroencephalogram (EEG) signals of five words (sos, stop, medicine, washroom, comehere) from 13 subjects. We have used the Hilbert transform to calculate time and joint time-frequency features from the imagined EEG signals. The above features are extracted individually in electrodes corresponding to nine brain regions. Each region of the brain is further analyzed in seven EEG frequency bands. The imagined speech features from each of the 63 combinations of brain region and frequency band are classified by the proposed deep architectures like long short term memory (LSTM), gated recurrent unit, and convolutional neural network (CNN). Some combinations are also classified by six traditional machine learning classifiers for performance comparison. In a five-class classification framework, we achieved the average and maximum accuracy of 71.75% and 94.29%. CNN gave high accuracy, but LSTM gave less network prediction time. Our results show that the alpha band can classify imagined speech better than other frequency bands. We have implemented subject-independent BCI, and the results are better than the state-of-the-art methods present in the literature.
引用
收藏
页码:2725 / 2748
页数:24
相关论文
共 45 条
  • [1] Electroencephalography based imagined alphabets classification using spatial and time-domain features
    Agarwal, Prabhakar
    Kumar, Sandeep
    [J]. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2022, 32 (01) : 111 - 122
  • [2] Agarwal P, 2021, INDIAN J PURE AP PHY, V59, P180
  • [3] [Anonymous], 2014, Hilbert-Huang transform and its applications
  • [4] Attoh-Okine NO, 2005, HILBERT-HUANG TRANSFORM IN ENGINEERING, P281, DOI 10.1201/9781420027532.ch13
  • [5] EEG signal classification of imagined speech based on Riemannian distance of correntropy spectral density
    Bakhshali, Mohamad Amin
    Khademi, Morteza
    Ebrahimi-Moghadam, Abbas
    Moghimi, Sahar
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2020, 59
  • [6] EEG-Based Multiword Imagined Speech Classification for Persian Words
    Bejestani, M. R. Asghari
    Khani, Gh R. Mohammad
    Nafisi, V. R.
    Darakeh, F.
    [J]. BIOMED RESEARCH INTERNATIONAL, 2022, 2022
  • [7] Cho KYHY, 2014, Arxiv, DOI arXiv:1406.1078
  • [8] D'Zmura M, 2009, LECT NOTES COMPUT SC, V5610, P40, DOI 10.1007/978-3-642-02574-7_5
  • [9] Single-trial classification of vowel speech imagery using common spatial patterns
    DaSalla, Charles S.
    Kambara, Hiroyuki
    Sato, Makoto
    Koike, Yasuharu
    [J]. NEURAL NETWORKS, 2009, 22 (09) : 1334 - 1339
  • [10] EEG classification of imagined syllable rhythm using Hilbert spectrum methods
    Deng, Siyi
    Srinivasan, Ramesh
    Lappas, Tom
    D'Zmura, Michael
    [J]. JOURNAL OF NEURAL ENGINEERING, 2010, 7 (04)