Classification of group speech imagined EEG signals based on attention mechanism and deep learning

被引:0
|
作者
Zhou, Yifan [1 ]
Zhang, Lingwei [1 ,2 ]
Zhou, Zhengdong [1 ]
Cai, Zhi [1 ]
Yuan, Mengyao [1 ]
Yuan, Xiaoxi [1 ]
Yang, Zeyi [1 ]
机构
[1] State Key Laboratory of Mechanics and Control for Aerosрace Structures, Nanjing University of Aeronautics and Astronautics, Nanjing,210016, China
[2] VeriSilicon Holdings (Nanjing) Co. Ltd, Nanjing,210000, China
来源
Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science) | 2024年 / 58卷 / 12期
关键词
Biomedical signal processing - Deep neural networks - Electroencephalography - Fourier transforms - Image enhancement - Speech enhancement;
D O I
10.3785/j.issn.1008-973X.2024.12.013
中图分类号
学科分类号
摘要
A classification method based on convolutional block attention module (CBAM) and Inception-V4 convolutional neural network was proposed to improve the classification accuracy of group EEG signals of imagined speech. CBAM was used to emphasize significant localized areas and extract distinctive features from the output feature map of convolutional neural network (CNN), so as to improve the classification performance of group EEG signals of imagined speech. The group EEG signals of imagined speech were converted into time-frequency images by short-time Fourier transform, then the images were used to train the Inception-V4 network incorporating with CBAM. Experiments on an open-accessed dataset showed that the proposed method achieved an accuracy of 52.2% in classifying six types of short words, which was 4.1 percentage points higher than that with Inception-V4 and was 5.9 percentage points higher than that with VGG-16. Furthermore, the training time can be reduced greatly with transfer learning. © 2024 Zhejiang University. All rights reserved.
引用
收藏
页码:2540 / 2546
相关论文
共 50 条
  • [1] Imagined Speech Classification Using EEG and Deep Learning
    Abdulghani, Mokhles M.
    Walters, Wilbur L.
    Abed, Khalid H.
    BIOENGINEERING-BASEL, 2023, 10 (06):
  • [2] Classification of imagined speech EEG signals based on feature fusion
    Zhang L.-W.
    Zhou Z.-D.
    Xu Y.-F.
    Wang J.-W.
    Ji W.-T.
    Song Z.-F.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2023, 57 (04): : 726 - 734
  • [3] Classification of Imagined Speech EEG Signals with DWT and SVM
    ZHANG Lingwei
    ZHOU Zhengdong
    XU Yunfei
    JI Wentao
    WANG Jiawen
    SONG Zefeng
    Instrumentation, 2022, 9 (02) : 56 - 63
  • [4] Inner Speech Classification using EEG Signals: A Deep Learning Approach
    Van den Berg, Bram
    Van Donkelaar, Sander
    Alimardani, Maryam
    PROCEEDINGS OF THE 2021 IEEE INTERNATIONAL CONFERENCE ON HUMAN-MACHINE SYSTEMS (ICHMS), 2021, : 258 - 261
  • [5] Multiclass Classification of Imagined Speech Vowels and Words of Electroencephalography Signals Using Deep Learning
    Mahapatra, Nrushingh Charan
    Bhuyan, Prachet
    ADVANCES IN HUMAN-COMPUTER INTERACTION, 2022, 2022
  • [6] Classification of Motor Imagery EEG Signals Based on Channel Attention Mechanism
    Yu, Yue
    Ji, Wenkai
    Zhao, Liming
    Sun, Zhongbo
    Liu, Keping
    2023 IEEE 12TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE, DDCLS, 2023, : 1720 - 1725
  • [7] Imbalanced classification for epileptic EEG signals based on deep learning
    Fei, Honglei
    Yuan, Qi
    Zheng, Yuye
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2021, 42 (03): : 231 - 240
  • [8] Multi-view Learning for EEG Signal Classification of Imagined Speech
    Barajas Montiel, Sandra Eugenia
    Morales, Eduardo F.
    Jair Escalante, Hugo
    PATTERN RECOGNITION, MCPR 2022, 2022, 13264 : 191 - 200
  • [9] Word-Based Classification of Imagined Speech Using EEG
    Hashim, Noramiza
    Ali, Aziah
    Mohd-Isa, Wan-Noorshahida
    COMPUTATIONAL SCIENCE AND TECHNOLOGY, ICCST 2017, 2018, 488 : 195 - 204
  • [10] Hierarchical Deep Feature Learning for Decoding Imagined Speech from EEG
    Saha, Pramit
    Fels, Sidney
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 10019 - 10020