Confused or not Confused? Disentangling Brain Activity from EEG Data Using Bidirectional LSTM Recurrent Neural Networks

被引:32
作者
Ni, Zhaoheng [1 ]
Yuksel, Ahmet Cem [1 ]
Ni, Xiuyan [1 ]
Mandel, Michael I. [2 ]
Xie, Lei [3 ]
机构
[1] CUNY, Grad Ctr, New York, NY 10016 USA
[2] CUNY Brooklyn Coll, Brooklyn, NY 11210 USA
[3] CUNY Hunter Coll, New York, NY 10065 USA
来源
ACM-BCB' 2017: PROCEEDINGS OF THE 8TH ACM INTERNATIONAL CONFERENCE ON BIOINFORMATICS, COMPUTATIONAL BIOLOGY,AND HEALTH INFORMATICS | 2017年
关键词
Confusion Detection; EEG; LSTM; Machine Learning; CLASSIFICATION;
D O I
10.1145/3107411.3107513
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Brain fog, also known as confusion, is one of the main reasons for low performance in the learning process or any kind of daily task that involves and requires thinking. Detecting confusion in a human's mind in real time is a challenging and important task that can be applied to online education, driver fatigue detection and so on. In this paper, we apply Bidirectional LSTM Recurrent Neural Networks to classify students' confusion in watching online course videos from EEG data. The results show that Bidirectional LSTM model achieves the state-of-the-art performance compared with other machine learning approaches, and shows strong robustness as evaluated by cross-validation. We can predict whether or not a student is confused in the accuracy of 73.3%. Furthermore, we find the most important feature to detecting the brain confusion is the gamma 1 wave of EEG signal. Our results suggest that machine learning is a potentially powerful tool to model and understand brain activity.
引用
收藏
页码:241 / 246
页数:6
相关论文
共 15 条
[1]  
[Anonymous], 2008, Advances in neural information processing systems
[2]  
Cooijmans T., 2016, CoRR
[3]  
Hajinoroozi M, 2015, 2015 IEEE CHINA SUMMIT & INTERNATIONAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING, P812, DOI 10.1109/ChinaSIP.2015.7230517
[4]  
Hochreiter S, 1997, NEURAL COMPUT, V9, P1735, DOI [10.1162/neco.1997.9.1.1, 10.1007/978-3-642-24797-2]
[5]  
Ioffe Sergey, 2015, PROC INT C MACH LEAR, V37, P448, DOI DOI 10.48550/ARXIV.1502.03167
[6]  
Laurent C, 2016, INT CONF ACOUST SPEE, P2657, DOI 10.1109/ICASSP.2016.7472159
[7]  
Lee H, 2009, Proceedings of the 26th International Conference On Machine Learning, ICML 2009. June 14, V26, P609, DOI [DOI 10.1145/1553374.1553453, 10.114 5/1553374.1553453]
[8]  
NeuroSky, 2009, NEUROSKYS ESENSE MET
[9]   Recurrent neural network-based approach for early recognition of Alzheimer's disease in EEG [J].
Petrosian, AA ;
Prokhorov, DV ;
Lajara-Nanson, W ;
Schiffer, RB .
CLINICAL NEUROPHYSIOLOGY, 2001, 112 (08) :1378-1387
[10]   EEG signal classification using PCA, ICA, LDA and support vector machines [J].
Subasi, Abdulhamit ;
Gursoy, M. Ismail .
EXPERT SYSTEMS WITH APPLICATIONS, 2010, 37 (12) :8659-8666