Illuminating the Neural Landscape of Pilot Mental States: A Convolutional Neural Network Approach with Shapley Additive Explanations Interpretability

被引:5
作者
Alreshidi, Ibrahim [1 ,2 ,3 ]
Bisandu, Desmond [1 ,2 ]
Moulitsas, Irene [1 ,2 ]
机构
[1] Cranfield Univ, Ctr Computat Engn Sci, Cranfield MK43 0AL, England
[2] Cranfield Univ, Digital Aviat Res & Technol Ctr DARTeC, Machine Learning & Data Analyt Lab, Cranfield MK43 0AL, England
[3] Univ Hail, Coll Comp Sci & Engn, Hail 81451, Saudi Arabia
关键词
aviation safety; convolutional neural network; deep learning; EEG; electroencephalogram; interpretability/explainability; machine learning; mental states classification; pilot deficiencies; SHapley Additive exPlanations; EEG; ALPHA;
D O I
10.3390/s23229052
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Predicting pilots' mental states is a critical challenge in aviation safety and performance, with electroencephalogram data offering a promising avenue for detection. However, the interpretability of machine learning and deep learning models, which are often used for such tasks, remains a significant issue. This study aims to address these challenges by developing an interpretable model to detect four mental states-channelised attention, diverted attention, startle/surprise, and normal state-in pilots using EEG data. The methodology involves training a convolutional neural network on power spectral density features of EEG data from 17 pilots. The model's interpretability is enhanced via the use of SHapley Additive exPlanations values, which identify the top 10 most influential features for each mental state. The results demonstrate high performance in all metrics, with an average accuracy of 96%, a precision of 96%, a recall of 94%, and an F1 score of 95%. An examination of the effects of mental states on EEG frequency bands further elucidates the neural mechanisms underlying these states. The innovative nature of this study lies in its combination of high-performance model development, improved interpretability, and in-depth analysis of the neural correlates of mental states. This approach not only addresses the critical need for effective and interpretable mental state detection in aviation but also contributes to our understanding of the neural underpinnings of these states. This study thus represents a significant advancement in the field of EEG-based mental state detection.
引用
收藏
页数:20
相关论文
共 41 条
  • [1] End-to-end environmental sound classification using a 1D convolutional neural network
    Abdoli, Sajjad
    Cardinal, Patrick
    Koerich, Alessandro Lameiras
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2019, 136 : 252 - 263
  • [2] Alreshidi I., 2023, AIAA AVIATION 2023 Forum
  • [3] Alreshidi I.M., 2022, P 6 INT C ADV ART IN, P29, DOI [10.1145/3571560.3571565, DOI 10.1145/3571560.3571565]
  • [4] Multimodal Approach for Pilot Mental State Detection Based on EEG
    Alreshidi, Ibrahim
    Moulitsas, Irene
    Jenkins, Karl W.
    [J]. SENSORS, 2023, 23 (17)
  • [5] Gamma, alpha, delta, and theta oscillations govern cognitive processes
    Basar, E
    Basar-Eroglu, C
    Karakas, S
    Schürmann, M
    [J]. INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2001, 39 (2-3) : 241 - 248
  • [6] Bashivan P., 2016, P 4 INT C LEARN REPR
  • [7] A Machine Learning Approach to the Detection of Pilot's Reaction to Unexpected Events Based on EEG Signals
    Binias, Bartosz
    Myszor, Dariusz
    Cyran, Krzysztof A.
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2018, 2018
  • [8] Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness
    Borghini, Gianluca
    Astolfi, Laura
    Vecchiato, Giovanni
    Mattia, Donatella
    Babiloni, Fabio
    [J]. NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2014, 44 : 58 - 75
  • [9] The origin of extracellular fields and currents - EEG, ECoG, LFP and spikes
    Buzsaki, Gyoergy
    Anastassiou, Costas A.
    Koch, Christof
    [J]. NATURE REVIEWS NEUROSCIENCE, 2012, 13 (06) : 407 - 420
  • [10] Multimodal Approach for Emotion Recognition Based on Simulated Flight Experiments
    Cavalcanti Roza, Valber Cesar
    Postolache, Octavian Adrian
    [J]. SENSORS, 2019, 19 (24)