Continuous decoding of cognitive load from electroencephalography reveals task-general and task-specific correlates

被引:19
作者
Boring, Matthew J. [1 ,2 ]
Ridgeway, Karl [1 ]
Shvartsman, Michael [1 ]
Jonker, Tanya R. [1 ]
机构
[1] Facebook Real Labs, Redmond, WA 98052 USA
[2] Univ Pittsburgh, Ctr Neurosci, Pittsburgh, PA 15260 USA
关键词
cognitive load; mental effort; electroencephalography; cross-task; decoding; generalization; WORKING-MEMORY LOAD; WORKLOAD CLASSIFICATION; INDIVIDUAL-DIFFERENCES; EEG; PERFORMANCE; ALPHA; THETA; ATTENTION;
D O I
10.1088/1741-2552/abb9bc
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective. Algorithms to detect changes in cognitive load using non-invasive biosensors (e.g. electroencephalography (EEG)) have the potential to improve human-computer interactions by adapting systems to an individual's current information processing capacity, which may enhance performance and mitigate costly errors. However, for algorithms to provide maximal utility, they must be able to detect load across a variety of tasks and contexts. The current study aimed to build models that capture task-general EEG correlates of cognitive load, which would allow for load detection across variable task contexts.Approach. Sliding-window support vector machines (SVM) were trained to predict periods of high versus low cognitive load across three cognitively and perceptually distinct tasks: n-back, mental arithmetic, and multi-object tracking. To determine how well these SVMs could generalize to novel tasks, they were trained on data from two of the three tasks and evaluated on the held-out task. Additionally, to better understand task-general and task-specific correlates of cognitive load, a set of models were trained on subsets of EEG frequency features.Main results. Models achieved reliable performance in classifying periods of high versus low cognitive load both within and across tasks, demonstrating their generalizability. Furthermore, continuous model outputs correlated with subtle differences in self-reported mental effort and they captured predicted changes in load within individual trials of each task. Additionally, alpha or beta frequency features achieved reliable within- and cross-task performance, suggesting that activity in these frequency bands capture task-general signatures of cognitive load. In contrast, delta and theta frequency features performed considerably worse than the full cross-task models, suggesting that delta and theta activity may be reflective of task-specific differences across cognitive load conditions.Significance. EEG data contains task-general signatures of cognitive load. Sliding-window SVMs can capture these signatures and continuously detect load across multiple task contexts.
引用
收藏
页数:17
相关论文
共 53 条
  • [1] ASHCRAFT MH, 1978, J EXP PSYCHOL-HUM L, V4, P527, DOI 10.1037/0278-7393.4.5.527
  • [2] A continuous time-resolved measure decoded from EEG oscillatory activity predicts working memory task performance
    Astrand, Elaine
    [J]. JOURNAL OF NEURAL ENGINEERING, 2018, 15 (03)
  • [3] Adaptive training using an artificial neural network and EEG metrics for within- and cross-task workload classification
    Baldwin, Carryl L.
    Penaranda, B. N.
    [J]. NEUROIMAGE, 2012, 59 (01) : 48 - 56
  • [4] Bashivan P., 2016, P INT C LEARN REPR 2
  • [5] Bates D, 2015, ARXIV150604967
  • [6] Estimating workload using EEG spectral power and ERPs in the n-back task
    Brouwer, Anne-Marie
    Hogervorst, Maarten A.
    van Erp, Jan B. F.
    Heffelaar, Tobias
    Zimmerman, Patrick H.
    Oostenveld, Robert
    [J]. JOURNAL OF NEURAL ENGINEERING, 2012, 9 (04)
  • [7] Tracking multiple targets with multifocal attention
    Cavanagh, P
    Alvarez, GA
    [J]. TRENDS IN COGNITIVE SCIENCES, 2005, 9 (07) : 349 - 354
  • [8] Chang CY, 2018, IEEE ENG MED BIO, P1242, DOI 10.1109/EMBC.2018.8512547
  • [9] LIBSVM: A Library for Support Vector Machines
    Chang, Chih-Chung
    Lin, Chih-Jen
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
  • [10] The effects of day-to-day variability of physiological data on operator functional state classification
    Christensen, James C.
    Estepp, Justin R.
    Wilson, Glenn F.
    Russell, Christopher A.
    [J]. NEUROIMAGE, 2012, 59 (01) : 57 - 63