Fuzzy temporal convolutional neural networks in P300-based Brain-computer interface for smart home interaction

被引:24
作者
Verga, Christian Flores [1 ,2 ]
Quevedo, Jonathan [1 ]
Escandon, Elmer [1 ]
Kiani, Mehrin [3 ]
Ding, Weiping [4 ]
Andreu-Perez, Javier [3 ,5 ]
机构
[1] Univ Ingn Tecnologia UTEC, Dept Elect Engn, Lima, Peru
[2] Univ Estadual Campinas, Sch Elect & Comp Engn, Sao Paulo, Brazil
[3] Univ Essex, Ctr Computat Intelligence, Colchester, England
[4] Nantong Univ, Sch Informat Sci & Technol, Nantong 226019, Peoples R China
[5] Univ Jaen, Jaen, Spain
基金
中国国家自然科学基金;
关键词
EEG-based BCI; P300; Smart home interaction; Convolutional neural networks; Fuzzy neural networks; Temporal neural networks; CLASSIFICATION;
D O I
10.1016/j.asoc.2021.108359
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The processing and classification of electroencephalographic signals (EEG) are increasingly performed using deep learning frameworks, such as convolutional neural networks (CNNs), to generate abstract features from brain data, automatically paving the way for remarkable classification prowess. However, EEG patterns exhibit high variability across time and uncertainty due to noise. It is a significant problem to be addressed in P300-based Brain Computer Interface (BCI) for smart home interaction. It operates in a non-optimal natural environment where added noise is often present. In this work, we propose a sequential unification of temporal convolutional networks (TCNs) modified to EEG signals, LSTM cells, with a fuzzy neural block (FNB), we called EEG-TCFNet. Fuzzy components may enable a higher tolerance to noisy conditions. We applied three different architectures comparing the effect of using block FNB to classify a P300 wave to build a BCI for smart home interaction with healthy and post-stroke individuals. Our results reported a maximum classification accuracy of 98.6% and 74.3% using the proposed method of EEG-TCFNet in subject-dependent strategy and subject-independent strategy, respectively. Overall, FNB usage in all three CNN topologies outperformed those without FNB. In addition, we compared the addition of FNB to other state-of-the-art methods and obtained higher classification accuracies on account of the integration with FNB. The remarkable performance of the proposed model, EEG-TCFNet, and the general integration of fuzzy units to other classifiers would pave the way for enhanced P300-based BCIs for smart home interaction within natural settings. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 30 条
[1]  
Achanccaray D, 2017, IEEE INT CONF FUZZY
[2]   A Self-Adaptive Online Brain-Machine Interface of a Humanoid Robot Through a General Type-2 Fuzzy Inference System [J].
Andreu-Perez, Javier ;
Cao, Fan ;
Hagras, Hani ;
Yang, Guang-Zhong .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2018, 26 (01) :101-116
[3]  
Bai S., 2018, CoRR abs/1803.01271
[4]  
Cecotti H, 2019, IEEE ENG MED BIO, P4160, DOI [10.1109/EMBC.2019.8856485, 10.1109/embc.2019.8856485]
[5]   Spelling with non-invasive Brain-Computer Interfaces - Current and future trends [J].
Cecotti, Hubert .
JOURNAL OF PHYSIOLOGY-PARIS, 2011, 105 (1-3) :106-114
[6]   Review of EEG Signal Classification [J].
Chakole, Ashlesha R. ;
Barekar, Praful, V ;
Ambulkar, Rajeshree, V ;
Kamble, Shailesh D. .
INFORMATION AND COMMUNICATION TECHNOLOGY FOR INTELLIGENT SYSTEMS, ICTIS 2018, VOL 2, 2019, 107 :105-114
[7]  
Cortez Sergio A., 2021, Proceedings of the 5th Brazilian Technology Symposium. Emerging Trends, Issues, and Challenges in the Brazilian Technology. Smart Innovation, Systems and Technologies (SIST 2020), P131, DOI 10.1007/978-3-030-57566-3_13
[8]  
Cortez S. A., 2020, 2020 IEEE 27 INT C E
[9]  
Cortez SA, 2020, 2020 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), P576, DOI [10.1109/ssci47803.2020.9308174, 10.1109/SSCI47803.2020.9308174]
[10]  
Cortez SA, 2020, IEEE SYS MAN CYBERN, P2972, DOI [10.1109/smc42975.2020.9283178, 10.1109/SMC42975.2020.9283178]