Classification of group speech imagined EEG signals based on attention mechanism and deep learning

被引:0
作者
Zhou, Yifan [1 ]
Zhang, Lingwei [1 ,2 ]
Zhou, Zhengdong [1 ]
Cai, Zhi [1 ]
Yuan, Mengyao [1 ]
Yuan, Xiaoxi [1 ]
Yang, Zeyi [1 ]
机构
[1] State Key Laboratory of Mechanics and Control for Aerosрace Structures, Nanjing University of Aeronautics and Astronautics, Nanjing
[2] VeriSilicon Holdings (Nanjing) Co. Ltd, Nanjing
来源
Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science) | 2024年 / 58卷 / 12期
关键词
attention mechanism; brain-computer interface; deep learning; electroencephalogram; speech imagery;
D O I
10.3785/j.issn.1008-973X.2024.12.013
中图分类号
学科分类号
摘要
A classification method based on convolutional block attention module (CBAM) and Inception-V4 convolutional neural network was proposed to improve the classification accuracy of group EEG signals of imagined speech. CBAM was used to emphasize significant localized areas and extract distinctive features from the output feature map of convolutional neural network (CNN), so as to improve the classification performance of group EEG signals of imagined speech. The group EEG signals of imagined speech were converted into time-frequency images by short-time Fourier transform, then the images were used to train the Inception-V4 network incorporating with CBAM. Experiments on an open-accessed dataset showed that the proposed method achieved an accuracy of 52.2% in classifying six types of short words, which was 4.1 percentage points higher than that with Inception-V4 and was 5.9 percentage points higher than that with VGG-16. Furthermore, the training time can be reduced greatly with transfer learning. © 2024 Zhejiang University. All rights reserved.
引用
收藏
页码:2540 / 2546
页数:6
相关论文
共 50 条
[31]   Classification of Alzheimer's dementia EEG signals using deep learning [J].
Sen, Sena Yagmur ;
Cura, Ozlem Karabiber ;
Yilmaz, Gulce Cosku ;
Akan, Aydin .
TRANSACTIONS OF THE INSTITUTE OF MEASUREMENT AND CONTROL, 2025, 47 (07) :1353-1365
[32]   Spectro-Spatio-Temporal EEG Representation Learning for Imagined Speech Recognition [J].
Ko, Wonjun ;
Jeon, Eunjin ;
Suk, Heung-Il .
PATTERN RECOGNITION, ACPR 2021, PT II, 2022, 13189 :335-346
[33]   A deep learning approach for decoding visually imagined digits and lettersusing time-frequency-spatial representation of EEG signals [J].
Alazrai, Rami ;
Abuhijleh, Motaz ;
Ali, Mostafa Z. ;
Daoud, Mohammad I. .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 203
[34]   Inferring imagined speech using EEG signals: a new approach using Riemannian manifold features [J].
Nguyen, Chuong H. ;
Karavas, George K. ;
Artemiadis, Panagiotis .
JOURNAL OF NEURAL ENGINEERING, 2018, 15 (01)
[35]   Diff-E: Diffusion-based Learning for Decoding Imagined Speech EEG [J].
Kim, Soowon ;
Lee, Young-Eun ;
Lee, Seo-Hyun ;
Lee, Seong-Whan .
INTERSPEECH 2023, 2023, :1159-1163
[36]   Audio assisted EEG segmentation for training of Imagined speech classification model [J].
Varshney, Yash Vardhan ;
Khan, Azizuddin .
INTERNATIONAL CONFERENCE ON ELECTRICAL, COMPUTER AND ENERGY TECHNOLOGIES (ICECET 2021), 2021, :1280-1284
[37]   Classification of Imagined Writing from EEG Signals using Autoregressive Features [J].
Zabidi, A. ;
Mansor, W. ;
Khuan, Y. L. ;
Fadzal, C. W. N. F. Che Wan .
2012 IEEE SYMPOSIUM ON COMPUTER APPLICATIONS AND INDUSTRIAL ELECTRONICS (ISCAIE 2012), 2012,
[38]   Speech Imagery Classification using Length-Wise Training based on Deep Learning [J].
Lee, Byeong-Hoo ;
Kwon, Byeong-Hee ;
Lee, Do-Yeun ;
Jeong, Ji-Hoon .
2021 9TH IEEE INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE (BCI), 2021, :154-158
[39]   EEG-based imagined words classification using Hilbert transform and deep networks [J].
Agarwal, Prabhakar ;
Kumar, Sandeep .
MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (1) :2725-2748
[40]   EEG-based imagined words classification using Hilbert transform and deep networks [J].
Prabhakar Agarwal ;
Sandeep Kumar .
Multimedia Tools and Applications, 2024, 83 :2725-2748