Dual Attention Relation Network With Fine-Tuning for Few-Shot EEG Motor Imagery Classification

被引:24
作者
An, Sion [1 ]
Kim, Soopil [1 ]
Chikontwe, Philip [1 ]
Park, Sang Hyun [1 ]
机构
[1] Daegu Gyeongbuk Inst Sci & Technol DGIST, Dept Robot & Mechatron Engn, Daegu 42988, South Korea
关键词
Brain modeling; Feature extraction; Electroencephalography; Data models; Adaptation models; Task analysis; Metalearning; Brain-computer interfaces; electroencephalography (EEG); few-shot classification; meta-learning; motor imagery (MI);
D O I
10.1109/TNNLS.2023.3287181
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, motor imagery (MI) electroencephalography (EEG) classification techniques using deep learning have shown improved performance over conventional techniques. However, improving the classification accuracy on unseen subjects is still challenging due to intersubject variability, scarcity of labeled unseen subject data, and low signal-to-noise ratio (SNR). In this context, we propose a novel two-way few-shot network able to efficiently learn how to learn representative features of unseen subject categories and classify them with limited MI EEG data. The pipeline includes an embedding module that learns feature representations from a set of signals, a temporal-attention module to emphasize important temporal features, an aggregation-attention module for key support signal discovery, and a relation module for final classification based on relation scores between a support set and a query signal. In addition to the unified learning of feature similarity and a few-shot classifier, our method can emphasize informative features in support data relevant to the query, which generalizes better on unseen subjects. Furthermore, we propose to fine-tune the model before testing by arbitrarily sampling a query signal from the provided support set to adapt to the distribution of the unseen subject. We evaluate our proposed method with three different embedding modules on cross-subject and cross-dataset classification tasks using brain-computer interface (BCI) competition IV 2a, 2b, and GIST datasets. Extensive experiments show that our model significantly improves over the baselines and outperforms existing few-shot approaches.
引用
收藏
页码:15479 / 15493
页数:15
相关论文
共 84 条
[1]   Deep convolutional neural network for the automated detection and diagnosis of seizure using EEG signals [J].
Acharya, U. Rajendra ;
Oh, Shu Lih ;
Hagiwara, Yuki ;
Tan, Jen Hong ;
Adeli, Hojjat .
COMPUTERS IN BIOLOGY AND MEDICINE, 2018, 100 :270-278
[2]   Physics-Informed Attention Temporal Convolutional Network for EEG-Based Motor Imagery Classification [J].
Altaheri, Hamdi ;
Muhammad, Ghulam ;
Alsulaiman, Mansour .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (02) :2249-2258
[3]   A Multi-Branch Convolutional Neural Network with Squeeze-and-Excitation Attention Blocks for EEG-Based Motor Imagery Signals Classification [J].
Altuwaijri, Ghadir Ali ;
Muhammad, Ghulam ;
Altaheri, Hamdi ;
Alsulaiman, Mansour .
DIAGNOSTICS, 2022, 12 (04)
[4]   Attention-Inception and Long- Short-Term Memory-Based Electroencephalography Classification for Motor Imagery Tasks in Rehabilitation [J].
Amin, Syed Umar ;
Altaheri, Hamdi ;
Muhammad, Ghulam ;
Abdul, Wadood ;
Alsulaiman, Mansour .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (08) :5412-5421
[5]   Multilevel Weighted Feature Fusion Using Convolutional Neural Networks for EEG Motor Imagery Classification [J].
Amin, Syed Umar ;
Alsulaiman, Mansour ;
Muhammad, Ghulam ;
Bencherif, Mohamed A. ;
Hossain, M. Shamim .
IEEE ACCESS, 2019, 7 :18940-18950
[6]   Few-Shot Relation Learning with Attention for EEG-based Motor Imagery Classification [J].
An, Sion ;
Kim, Soopil ;
Chikontwe, Philip ;
Park, Sang Hyun .
2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, :10933-10938
[7]   Dendrite morphological neural networks for motor task recognition from electroencephalographic signals [J].
Antelis, Javier M. ;
Gudino-Mendoza, Berenice ;
Eduardo Falcon, Luis ;
Sanchez-Ante, Gildardo ;
Sossa, Humberto .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2018, 44 :12-24
[8]  
Ba J, 2014, ACS SYM SER
[9]   Spatio-Spectral Feature Representation for Motor Imagery Classification Using Convolutional Neural Networks [J].
Bang, Ji-Seon ;
Lee, Min-Ho ;
Fazli, Siamac ;
Guan, Cuntai ;
Lee, Seong-Whan .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (07) :3038-3049
[10]   Classification of motor imagery movements using multivariate empirical mode decomposition and short time Fourier transform based hybrid method [J].
Bashar, Syed Khairul ;
Bhuiyan, Mohammed Imamul Hassan .
ENGINEERING SCIENCE AND TECHNOLOGY-AN INTERNATIONAL JOURNAL-JESTECH, 2016, 19 (03) :1457-1464