Automated EEG sentence classification using novel dynamic-sized binary pattern and multilevel discrete wavelet transform techniques with TSEEG database

被引:12
作者
Barua, Prabal Datta [1 ,2 ]
Keles, Tugce [3 ]
Dogan, Sengul [3 ]
Baygin, Mehmet [4 ]
Tuncer, Turker [3 ]
Demir, Caner Feyzi [5 ]
Fujita, Hamido [6 ,7 ,8 ]
Tan, Ru-San [9 ,10 ]
Ooi, Chui Ping [11 ]
Acharya, U. Rajendra [12 ,13 ,14 ]
机构
[1] Univ Southern Queensland, Sch Business Informat Syst, Toowoomba, Qld 4350, Australia
[2] Univ Technol Sydney, Fac Engn & Informat Technol, Sydney, NSW 2007, Australia
[3] Firat Univ, Technol Fac, Dept Digital Forens Engn, Elazig, Turkiye
[4] Ardahan Univ, Fac Engn, Dept Comp Engn, Ardahan, Turkiye
[5] Firat Univ, Firat Univ Hosp, Dept Neurol, TR-23119 Elazig, Turkiye
[6] HUTECH Univ Technol, Fac Informat Technol, Ho Chi Minh City, Vietnam
[7] Univ Granada, Andalusian Res Inst Data Sci & Computat Intellige, Granada, Spain
[8] Iwate Prefectural Univ, Reg Res Ctr, Takizawa, Iwate, Japan
[9] Natl Heart Ctr Singapore, Dept Cardiol, Singapore, Singapore
[10] Duke NUS Med Sch, Singapore, Singapore
[11] Singapore Univ Social Sci, Sch Sci & Technol, Singapore 599494, Singapore
[12] Ngee Ann Polytech, Dept Elect & Comp Engn, Singapore 599489, Singapore
[13] SUSS Univ, Sch Sci & Technol, Dept Biomed Engn, Singapore, Singapore
[14] Asia Univ, Dept Biomed Informat & Med Engn, Taichung, Taiwan
关键词
EEG sentence classification; Dynamic sized binary pattern; Iterative multi -classifiers based majority voting; Neighborhood component analysis; Machine learning; STATISTICAL FEATURES; FEATURE-EXTRACTION; IMPROVEMENT; KEYBOARD;
D O I
10.1016/j.bspc.2022.104055
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Electroencephalography (EEG) signal is an important physiological signal commonly used in machine learning to decode brain activities, including imagined words and sentences. We aimed to develop an automated lightweight EEG signal-based sentence classification model using a novel dynamic-sized binary pattern (DSBP) textural feature extractor and iterative multi-classifiers based majority voting (IMCMV) algorithm for iterative voting of results calculated using different classifiers for multi-channel EEG signal inputs. A new Turkish sentence EEG (TSEEG) was prospectively acquired. It comprised of 15-second 14-channel EEG signals recorded when 40 volunteers (for each dataset, we collected EEG signals from 20 participants) were either shown or read corre-sponding to demonstration or listening modes, respectively. Hence, 20 standardized commonly used sentences were obtained in their native Turkish language. The developed sentence classification model extracted 5,400 multilevel deep features from each channel EEG signal segment using the novel DSBP, statistical features, and multilevel discrete wavelet transform (MDWT). 512 features were then chosen using the neighborhood component analysis selection function. k-nearest neighbor and support vector machine classifiers were used to calculate two prediction vectors from the selected features using tenfold cross-validation, i.e., 28 vectors were generated for each 14-channel EEG recording. Finally, the best general voted results were determined for increasing numbers of iteratively calculated prediction vectors using the novel IMCMV algorithm. Channel-wise and voted results were found to be excellent for sentence classification for the TSEEG dataset in both demon-stration and listening modes. The DSBP-IMCMV-based model attained the best general classification rates of 98.81% and 98.19% in the demonstration and listening modes, respectively.
引用
收藏
页数:13
相关论文
共 44 条
[21]   Envisioned speech recognition using EEG sensors [J].
Kumar, Pradeep ;
Saini, Rajkumar ;
Roy, Partha Pratim ;
Sahu, Pawan Kumar ;
Dogra, Debi Prosad .
PERSONAL AND UBIQUITOUS COMPUTING, 2018, 22 (01) :185-199
[22]   New approaches based on local binary patterns for gender identification from sensor signals [J].
Kuncan, Fatma ;
Kaya, Yilmaz ;
Kuncan, Melih .
JOURNAL OF THE FACULTY OF ENGINEERING AND ARCHITECTURE OF GAZI UNIVERSITY, 2019, 34 (04) :2173-2185
[23]  
Powers DMW, 2020, Arxiv, DOI arXiv:2010.16061
[24]   An embedded lightweight SSVEP-BCI electric wheelchair with hybrid stimulator [J].
Na, Rui ;
Hu, Chun ;
Sun, Ying ;
Wang, Shuai ;
Zhang, Shuailei ;
Han, Mingzhe ;
Yin, Wenhan ;
Zhang, Jun ;
Chen, Xinlei ;
Zheng, Dezhi .
DIGITAL SIGNAL PROCESSING, 2021, 116
[25]   Recognition of Imagined Speech using Electroencephalogram Signals [J].
Neubig, Theresa ;
Sellami, Louiza .
SMART BIOMEDICAL AND PHYSIOLOGICAL SENSOR TECHNOLOGY XV, 2019, 11020
[26]   What is a support vector machine? [J].
Noble, William S. .
NATURE BIOTECHNOLOGY, 2006, 24 (12) :1565-1567
[27]   Decoding Imagined Speech using Wavelet Features and Deep Neural Networks [J].
Panachakel, Jerrin Thomas ;
Ramakrishnan, A. G. ;
Ananthapadmanabha, T., V .
2019 IEEE 16TH INDIA COUNCIL INTERNATIONAL CONFERENCE (IEEE INDICON 2019), 2019,
[28]  
Peterson L.E., 2009, Scholarpedia, V4, P1883, DOI DOI 10.4249/SCHOLARPEDIA.1883
[29]   Multiclass Classification of Word Imagination Speech With Hybrid Connectivity Features [J].
Qureshi, Muhammad Naveed Iqbal ;
Min, Beomjun ;
Park, Hyeong-jun ;
Cho, Dongrae ;
Choi, Woosu ;
Lee, Boreom .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2018, 65 (10) :2168-2177
[30]   Classification of focal and non-focal EEG signals using neighborhood component analysis and machine learning algorithms [J].
Raghu, Shivarudhrappa ;
Sriraam, Natarajan .
EXPERT SYSTEMS WITH APPLICATIONS, 2018, 113 :18-32