Brain-computer interface (BCI);
convolutional neural network (CNN);
motor imagery (MI);
training tricks;
transfer learning;
CONVOLUTIONAL NEURAL-NETWORKS;
BRAIN-COMPUTER INTERFACES;
DOMAIN ADAPTATION;
CLASSIFICATION;
SYSTEM;
D O I:
10.1109/TNNLS.2023.3269512
中图分类号:
TP18 [人工智能理论];
学科分类号:
081104 ;
0812 ;
0835 ;
1405 ;
摘要:
In recent years, with the rapid development of deep learning, various deep learning frameworks have been widely used in brain-computer interface (BCI) research for decoding motor imagery (MI) electroencephalogram (EEG) signals to understand brain activity accurately. The electrodes, however, record the mixed activities of neurons. If different features are directly embedded in the same feature space, the specific and mutual features of different neuron regions are not considered, which will reduce the expression ability of the feature itself. We propose a cross-channel specific-mutual feature transfer learning (CCSM-FT) network model to solve this problem. The multibranch network extracts the specific and mutual features of brain's multiregion signals. Effective training tricks are used to maximize the distinction between the two kinds of features. Suitable training tricks can also improve the effectiveness of the algorithm compared with novel models. Finally, we transfer two kinds of features to explore the potential of mutual and specific features to enhance the expressive power of the feature and use the auxiliary set to improve identification performance. The experimental results show that the network has a better classification effect in the BCI Competition IV-2a and the HGD datasets.
机构:
Georgia State Univ, Dept Phys & Astron, Suite 600,25 Pk Pl, Atlanta, GA 30303 USAGeorgia State Univ, Dept Phys & Astron, Suite 600,25 Pk Pl, Atlanta, GA 30303 USA
Bajaj, Sahil
;
Butler, Andrew J.
论文数: 0引用数: 0
h-index: 0
机构:
Georgia State Univ, Byrdine F Lewis Sch Nursing & Hlth Profess, Atlanta, GA 30303 USA
Dept Vet Affairs, Atlanta Rehabil Res & Dev Ctr Excellence, Decatur, GA USA
Georgia State Univ, Inst Neurosci, Atlanta, GA 30303 USAGeorgia State Univ, Dept Phys & Astron, Suite 600,25 Pk Pl, Atlanta, GA 30303 USA
Butler, Andrew J.
;
Drake, Daniel
论文数: 0引用数: 0
h-index: 0
机构:
Georgia State Univ, Byrdine F Lewis Sch Nursing & Hlth Profess, Atlanta, GA 30303 USAGeorgia State Univ, Dept Phys & Astron, Suite 600,25 Pk Pl, Atlanta, GA 30303 USA
机构:
Korea Univ, Dept Brain & Cognit Engn, Seoul 02841, South KoreaKorea Univ, Dept Brain & Cognit Engn, Seoul 02841, South Korea
Bang, Ji-Seon
;
Lee, Min-Ho
论文数: 0引用数: 0
h-index: 0
机构:
Nazarbayev Univ, Dept Comp Sci, Nur Sultan 010000, KazakhstanKorea Univ, Dept Brain & Cognit Engn, Seoul 02841, South Korea
Lee, Min-Ho
;
Fazli, Siamac
论文数: 0引用数: 0
h-index: 0
机构:
Nazarbayev Univ, Dept Comp Sci, Nur Sultan 010000, KazakhstanKorea Univ, Dept Brain & Cognit Engn, Seoul 02841, South Korea
Fazli, Siamac
;
Guan, Cuntai
论文数: 0引用数: 0
h-index: 0
机构:
Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, SingaporeKorea Univ, Dept Brain & Cognit Engn, Seoul 02841, South Korea
Guan, Cuntai
;
Lee, Seong-Whan
论文数: 0引用数: 0
h-index: 0
机构:
Korea Univ, Dept Brain & Cognit Engn, Seoul 02841, South Korea
Korea Univ, Dept Artificial Intelligence, Seoul 02841, South KoreaKorea Univ, Dept Brain & Cognit Engn, Seoul 02841, South Korea
机构:
South China Univ Technol, Coll Automat Sci & Engn, Guangzhou 510641, Peoples R China
Pazhou Lab, Guangzhou 510335, Peoples R ChinaSouth China Univ Technol, Coll Automat Sci & Engn, Guangzhou 510641, Peoples R China
Chen, Junjian
;
Yu, Zhuliang
论文数: 0引用数: 0
h-index: 0
机构:
South China Univ Technol, Coll Automat Sci & Engn, Guangzhou 510641, Peoples R China
Pazhou Lab, Guangzhou 510335, Peoples R ChinaSouth China Univ Technol, Coll Automat Sci & Engn, Guangzhou 510641, Peoples R China
Yu, Zhuliang
;
Gu, Zhenghui
论文数: 0引用数: 0
h-index: 0
机构:
South China Univ Technol, Coll Automat Sci & Engn, Guangzhou 510641, Peoples R China
Pazhou Lab, Guangzhou 510335, Peoples R ChinaSouth China Univ Technol, Coll Automat Sci & Engn, Guangzhou 510641, Peoples R China
Gu, Zhenghui
;
Li, Yuanqing
论文数: 0引用数: 0
h-index: 0
机构:
South China Univ Technol, Coll Automat Sci & Engn, Guangzhou 510641, Peoples R China
Pazhou Lab, Guangzhou 510335, Peoples R ChinaSouth China Univ Technol, Coll Automat Sci & Engn, Guangzhou 510641, Peoples R China
机构:
China Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China
Hubei Key Lab Adv Control & Intelligent Automat C, Wuhan 430074, Hubei, Peoples R ChinaChina Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China
Chen, Luefeng
;
Zhou, Mengtian
论文数: 0引用数: 0
h-index: 0
机构:
China Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China
Hubei Key Lab Adv Control & Intelligent Automat C, Wuhan 430074, Hubei, Peoples R ChinaChina Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China
Zhou, Mengtian
;
Wu, Min
论文数: 0引用数: 0
h-index: 0
机构:
China Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China
Hubei Key Lab Adv Control & Intelligent Automat C, Wuhan 430074, Hubei, Peoples R ChinaChina Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China
Wu, Min
;
She, Jinhua
论文数: 0引用数: 0
h-index: 0
机构:
China Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China
Hubei Key Lab Adv Control & Intelligent Automat C, Wuhan 430074, Hubei, Peoples R China
Tokyo Univ Technol, Sch Engn, Tokyo 1920982, JapanChina Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China
She, Jinhua
;
Liu, Zhentao
论文数: 0引用数: 0
h-index: 0
机构:
China Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China
Hubei Key Lab Adv Control & Intelligent Automat C, Wuhan 430074, Hubei, Peoples R ChinaChina Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China
Liu, Zhentao
;
Dong, Fangyan
论文数: 0引用数: 0
h-index: 0
机构:
Tokyo Inst Technol, Yokohama, Kanagawa 2268502, JapanChina Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China
机构:
Georgia State Univ, Dept Phys & Astron, Suite 600,25 Pk Pl, Atlanta, GA 30303 USAGeorgia State Univ, Dept Phys & Astron, Suite 600,25 Pk Pl, Atlanta, GA 30303 USA
Bajaj, Sahil
;
Butler, Andrew J.
论文数: 0引用数: 0
h-index: 0
机构:
Georgia State Univ, Byrdine F Lewis Sch Nursing & Hlth Profess, Atlanta, GA 30303 USA
Dept Vet Affairs, Atlanta Rehabil Res & Dev Ctr Excellence, Decatur, GA USA
Georgia State Univ, Inst Neurosci, Atlanta, GA 30303 USAGeorgia State Univ, Dept Phys & Astron, Suite 600,25 Pk Pl, Atlanta, GA 30303 USA
Butler, Andrew J.
;
Drake, Daniel
论文数: 0引用数: 0
h-index: 0
机构:
Georgia State Univ, Byrdine F Lewis Sch Nursing & Hlth Profess, Atlanta, GA 30303 USAGeorgia State Univ, Dept Phys & Astron, Suite 600,25 Pk Pl, Atlanta, GA 30303 USA
机构:
Korea Univ, Dept Brain & Cognit Engn, Seoul 02841, South KoreaKorea Univ, Dept Brain & Cognit Engn, Seoul 02841, South Korea
Bang, Ji-Seon
;
Lee, Min-Ho
论文数: 0引用数: 0
h-index: 0
机构:
Nazarbayev Univ, Dept Comp Sci, Nur Sultan 010000, KazakhstanKorea Univ, Dept Brain & Cognit Engn, Seoul 02841, South Korea
Lee, Min-Ho
;
Fazli, Siamac
论文数: 0引用数: 0
h-index: 0
机构:
Nazarbayev Univ, Dept Comp Sci, Nur Sultan 010000, KazakhstanKorea Univ, Dept Brain & Cognit Engn, Seoul 02841, South Korea
Fazli, Siamac
;
Guan, Cuntai
论文数: 0引用数: 0
h-index: 0
机构:
Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, SingaporeKorea Univ, Dept Brain & Cognit Engn, Seoul 02841, South Korea
Guan, Cuntai
;
Lee, Seong-Whan
论文数: 0引用数: 0
h-index: 0
机构:
Korea Univ, Dept Brain & Cognit Engn, Seoul 02841, South Korea
Korea Univ, Dept Artificial Intelligence, Seoul 02841, South KoreaKorea Univ, Dept Brain & Cognit Engn, Seoul 02841, South Korea
机构:
South China Univ Technol, Coll Automat Sci & Engn, Guangzhou 510641, Peoples R China
Pazhou Lab, Guangzhou 510335, Peoples R ChinaSouth China Univ Technol, Coll Automat Sci & Engn, Guangzhou 510641, Peoples R China
Chen, Junjian
;
Yu, Zhuliang
论文数: 0引用数: 0
h-index: 0
机构:
South China Univ Technol, Coll Automat Sci & Engn, Guangzhou 510641, Peoples R China
Pazhou Lab, Guangzhou 510335, Peoples R ChinaSouth China Univ Technol, Coll Automat Sci & Engn, Guangzhou 510641, Peoples R China
Yu, Zhuliang
;
Gu, Zhenghui
论文数: 0引用数: 0
h-index: 0
机构:
South China Univ Technol, Coll Automat Sci & Engn, Guangzhou 510641, Peoples R China
Pazhou Lab, Guangzhou 510335, Peoples R ChinaSouth China Univ Technol, Coll Automat Sci & Engn, Guangzhou 510641, Peoples R China
Gu, Zhenghui
;
Li, Yuanqing
论文数: 0引用数: 0
h-index: 0
机构:
South China Univ Technol, Coll Automat Sci & Engn, Guangzhou 510641, Peoples R China
Pazhou Lab, Guangzhou 510335, Peoples R ChinaSouth China Univ Technol, Coll Automat Sci & Engn, Guangzhou 510641, Peoples R China
机构:
China Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China
Hubei Key Lab Adv Control & Intelligent Automat C, Wuhan 430074, Hubei, Peoples R ChinaChina Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China
Chen, Luefeng
;
Zhou, Mengtian
论文数: 0引用数: 0
h-index: 0
机构:
China Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China
Hubei Key Lab Adv Control & Intelligent Automat C, Wuhan 430074, Hubei, Peoples R ChinaChina Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China
Zhou, Mengtian
;
Wu, Min
论文数: 0引用数: 0
h-index: 0
机构:
China Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China
Hubei Key Lab Adv Control & Intelligent Automat C, Wuhan 430074, Hubei, Peoples R ChinaChina Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China
Wu, Min
;
She, Jinhua
论文数: 0引用数: 0
h-index: 0
机构:
China Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China
Hubei Key Lab Adv Control & Intelligent Automat C, Wuhan 430074, Hubei, Peoples R China
Tokyo Univ Technol, Sch Engn, Tokyo 1920982, JapanChina Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China
She, Jinhua
;
Liu, Zhentao
论文数: 0引用数: 0
h-index: 0
机构:
China Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China
Hubei Key Lab Adv Control & Intelligent Automat C, Wuhan 430074, Hubei, Peoples R ChinaChina Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China
Liu, Zhentao
;
Dong, Fangyan
论文数: 0引用数: 0
h-index: 0
机构:
Tokyo Inst Technol, Yokohama, Kanagawa 2268502, JapanChina Univ Geosci, Sch Automat, Wuhan 430074, Hubei, Peoples R China