Continuous decoding of cognitive load from electroencephalography reveals task-general and task-specific correlates

被引:19
作者
Boring, Matthew J. [1 ,2 ]
Ridgeway, Karl [1 ]
Shvartsman, Michael [1 ]
Jonker, Tanya R. [1 ]
机构
[1] Facebook Real Labs, Redmond, WA 98052 USA
[2] Univ Pittsburgh, Ctr Neurosci, Pittsburgh, PA 15260 USA
关键词
cognitive load; mental effort; electroencephalography; cross-task; decoding; generalization; WORKING-MEMORY LOAD; WORKLOAD CLASSIFICATION; INDIVIDUAL-DIFFERENCES; EEG; PERFORMANCE; ALPHA; THETA; ATTENTION;
D O I
10.1088/1741-2552/abb9bc
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective. Algorithms to detect changes in cognitive load using non-invasive biosensors (e.g. electroencephalography (EEG)) have the potential to improve human-computer interactions by adapting systems to an individual's current information processing capacity, which may enhance performance and mitigate costly errors. However, for algorithms to provide maximal utility, they must be able to detect load across a variety of tasks and contexts. The current study aimed to build models that capture task-general EEG correlates of cognitive load, which would allow for load detection across variable task contexts.Approach. Sliding-window support vector machines (SVM) were trained to predict periods of high versus low cognitive load across three cognitively and perceptually distinct tasks: n-back, mental arithmetic, and multi-object tracking. To determine how well these SVMs could generalize to novel tasks, they were trained on data from two of the three tasks and evaluated on the held-out task. Additionally, to better understand task-general and task-specific correlates of cognitive load, a set of models were trained on subsets of EEG frequency features.Main results. Models achieved reliable performance in classifying periods of high versus low cognitive load both within and across tasks, demonstrating their generalizability. Furthermore, continuous model outputs correlated with subtle differences in self-reported mental effort and they captured predicted changes in load within individual trials of each task. Additionally, alpha or beta frequency features achieved reliable within- and cross-task performance, suggesting that activity in these frequency bands capture task-general signatures of cognitive load. In contrast, delta and theta frequency features performed considerably worse than the full cross-task models, suggesting that delta and theta activity may be reflective of task-specific differences across cognitive load conditions.Significance. EEG data contains task-general signatures of cognitive load. Sliding-window SVMs can capture these signatures and continuously detect load across multiple task contexts.
引用
收藏
页数:17
相关论文
共 53 条
  • [11] A Nondegenerate Penalized Likelihood Estimator for Variance Parameters in Multilevel Models
    Chung, Yeojin
    Rabe-Hesketh, Sophia
    Dorie, Vincent
    Gelman, Andrew
    Liu, Jingchen
    [J]. PSYCHOMETRIKA, 2013, 78 (04) : 685 - 709
  • [12] Cohen L, 2001, APPL NUM HARM ANAL, P217
  • [13] EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis
    Delorme, A
    Makeig, S
    [J]. JOURNAL OF NEUROSCIENCE METHODS, 2004, 134 (01) : 9 - 21
  • [14] Task-Independent Mental Workload Classification Based Upon Common Multiband EEG Cortical Connectivity
    Dimitrakopoulos, Georgios N.
    Kakkos, Ioannis
    Dai, Zhongxiang
    Lim, Julian
    deSouza, Joshua J.
    Bezerianos, Anastasios
    Sun, Yu
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2017, 25 (11) : 1940 - 1949
  • [15] Comparison of linear, nonlinear, and feature selection methods for EEG signal classification
    Garrett, D
    Peterson, DA
    Anderson, CW
    Thaut, MH
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2003, 11 (02) : 141 - 144
  • [16] INDIVIDUAL-DIFFERENCES IN COGNITIVE ARITHMETIC
    GEARY, DC
    WIDAMAN, KF
    [J]. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, 1987, 116 (02) : 154 - 171
  • [17] Cognitive state monitoring and the design of adaptive instruction in digital environments: lessons learned from cognitive workload assessment using a passive brain-computer interface approach
    Gerjets, Peter
    Walter, Carina
    Rosenstiel, Wolfgang
    Bogdan, Martin
    Zander, Thorsten O.
    [J]. FRONTIERS IN NEUROSCIENCE, 2014, 8
  • [18] High-resolution EEG mapping of cortical activation related to working memory: Effects of task difficulty, type of processing, and practice
    Gevins, A
    Smith, ME
    McEvoy, L
    Yu, D
    [J]. CEREBRAL CORTEX, 1997, 7 (04) : 374 - 385
  • [19] Monitoring working memory load during computer-based tasks with EEG pattern recognition methods
    Gevins, A
    Smith, ME
    Leong, H
    McEvoy, L
    Whitfield, S
    Du, R
    Rush, G
    [J]. HUMAN FACTORS, 1998, 40 (01) : 79 - 91
  • [20] GLASS A, 1970, Psychologische Forschung, V33, P85, DOI 10.1007/BF00424979