Deep Learning-Based Assessment Model for Real-Time Identification of Visual Learners Using Raw EEG

被引:9
作者
Jawed, Soyiba [1 ]
Faye, Ibrahima [2 ]
Malik, Aamir Saeed [3 ]
机构
[1] Brno Univ Technol, Fac Informat Technol, Brno 60167, Czech Republic
[2] Univ Teknol PETRONAS, Ctr Intelligent Signal & Imaging Res CISIR, Dept Fundamental & Appl Sci, Seri Iskandar 32610, Malaysia
[3] Brno Univ Technol, Fac Informat Technol, Dept Comp Syst, Brno 60167, Czech Republic
关键词
Raw-electroencephalogram; deep learning; machine learning; visual learner; classification; learning styles; CLASSIFICATION; STYLES; ENSEMBLE; SIGNALS; FMRI;
D O I
10.1109/TNSRE.2024.3351694
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Automatic identification of visual learning style in real time using raw electroencephalogram (EEG) is challenging. In this work, inspired by the powerful abilities of deep learning techniques, deep learning-based models are proposed to learn high-level feature representation for EEG visual learning identification. Existing computer-aided systems that use electroencephalograms and machine learning can reasonably assess learning styles. Despite their potential, offline processing is often necessary to eliminate artifacts and extract features, making these methods unsuitable for real-time applications. The dataset was chosen with 34 healthy subjects to measure their EEG signals during resting states (eyes open and eyes closed) and while performing learning tasks. The subjects displayed no prior knowledge of the animated educational content presented in video format. The paper presents an analysis of EEG signals measured during a resting state with closed eyes using three deep learning techniques: Long-term, short-term memory (LSTM), Long-term, short-term memory-convolutional neural network (LSTM-CNN), and Long-term, short-term memory-Fully convolutional neural network (LSTM-FCNN). The chosen techniques were based on their suitability for real-time applications with varying data lengths and the need for less computational time. The optimization of hypertuning parameters has enabled the identification of visual learners through the implementation of three techniques. LSTM-CNN technique has the highest average accuracy of 94%, a sensitivity of 80%, a specificity of 92%, and an F1 score of 94% when identifying the visual learning style of the student out of all three techniques. This research has shown that the most effective method is the deep learning-based LSTM-CNN technique, which accurately identifies a student's visual learning style.
引用
收藏
页码:378 / 390
页数:13
相关论文
共 36 条
[1]  
Alhagry S, 2017, INT J ADV COMPUT SC, V8, P355, DOI 10.14569/IJACSA.2017.081046
[2]  
Ali M. S. M., 2016, Int. J. Control Theory Appl., V9, P2985
[3]   Feature extraction and classification for EEG signals using wavelet transform and machine learning techniques [J].
Amin, Hafeez Ullah ;
Malik, Aamir Saeed ;
Ahmad, Rana Fayyaz ;
Badruddin, Nasreen ;
Kamel, Nidal ;
Hussain, Muhammad ;
Chooi, Weng-Tink .
AUSTRALASIAN PHYSICAL & ENGINEERING SCIENCES IN MEDICINE, 2015, 38 (01) :139-149
[4]  
[Anonymous], ADVANTAGES DISADVANT
[5]  
[Anonymous], Visual Learning Style
[6]   EEG-based intelligent system for cognitive behavior classification [J].
Anoor, Muhammad Marwan ;
Jahidin, Aisyah Hartini ;
Arof, Hamzah ;
Megat, Megat Syahirul Amin .
JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2020, 39 (01) :177-194
[7]   Decoding visual brain states from fMRI using an ensemble of classifiers [J].
Cabral, Carlos ;
Silveira, Margarida ;
Figueiredo, Patricia .
PATTERN RECOGNITION, 2012, 45 (06) :2064-2074
[8]   Survey of encoding and decoding of visual stimulus via FMRI: an image analysis perspective [J].
Chen, Mo ;
Han, Junwei ;
Hu, Xintao ;
Jiang, Xi ;
Guo, Lei ;
Liu, Tianming .
BRAIN IMAGING AND BEHAVIOR, 2014, 8 (01) :7-23
[9]  
Clerc M., 2016, Brain-Computer Interfaces 2: Technology and Applications
[10]   Deep learning for electroencephalogram (EEG) classification tasks: a review [J].
Craik, Alexander ;
He, Yongtian ;
Contreras-Vidal, Jose L. .
JOURNAL OF NEURAL ENGINEERING, 2019, 16 (03)