Decoding working-memory load during n-back task performance from high channel fNIRS data

被引:1
|
作者
Kothe, Christian [1 ]
Hanada, Grant [1 ]
Mullen, Sean [1 ]
Mullen, Tim [1 ]
机构
[1] Intheon, La Jolla, CA 92037 USA
关键词
Near-infrared spectroscopy; brain-computer interfaces; machine learning; high-density; workload; transfer learning; COGNITIVE CONTROL;
D O I
10.1088/1741-2552/ad731b
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective. Functional near-infrared spectroscopy (fNIRS) can measure neural activity through blood oxygenation changes in the brain in a wearable form factor, enabling unique applications for research in and outside the lab and in practical occupational settings. fNIRS has proven capable of measuring cognitive states such as mental workload, often using machine learning (ML) based brain-computer interfaces (BCIs). To date, this research has largely relied on probes with channel counts from under ten to several hundred, although recently a new class of wearable NIRS devices featuring thousands of channels has emerged. This poses unique challenges for ML classification, as fNIRS is typically limited by few training trials which results in severely under-determined estimation problems. So far, it is not well understood how such high-resolution data is best leveraged in practical BCIs and whether state-of-the-art or better performance can be achieved. Approach. To address these questions, we propose an ML strategy to classify working-memory load that relies on spatio-temporal regularization and transfer learning from other subjects in a combination that, to our knowledge, has not been used in previous fNIRS BCIs. The approach can be interpreted as an end-to-end generalized linear model and allows for a high degree of interpretability using channel-level or cortical imaging approaches. Main results. We show that using the proposed methodology, it is possible to achieve state-of-the-art decoding performance with high-resolution fNIRS data. We also replicated several state-of-the-art approaches on our dataset of 43 participants wearing a 3198 dual-channel NIRS device while performing the n-Back task and show that these existing methodologies struggle in the high-channel regime and are largely outperformed by the proposed pipeline. Significance. Our approach helps establish high-channel NIRS devices as a viable platform for state-of-the-art BCI and opens new applications using this class of headset while also enabling high-resolution model imaging and interpretation.
引用
收藏
页数:21
相关论文
共 50 条
  • [41] Novel n-back spatial working memory task using eye movement response
    Jeter, Cameron B.
    Patel, Saumil S.
    Sereno, Anne B.
    BEHAVIOR RESEARCH METHODS, 2011, 43 (03) : 879 - 887
  • [42] A task is a task is a task: putting complex span, n-back, and other working memory indicators in psychometric context
    Schmiedek, Florian
    Loevden, Martin
    Lindenberger, Ulman
    FRONTIERS IN PSYCHOLOGY, 2014, 5
  • [43] The modified n-back task: A valid, new instrument for the neuropsychological assessment of working memory
    Leon-Dominguez, Umberto
    Francisco Martin-Rodriguez, Juan
    Leon-Carrion, Jose
    BRAIN INJURY, 2016, 30 (5-6) : 489 - 490
  • [44] A male advantage for spatial and object but not verbal working memory using the n-back task
    Lejbak, Lisa
    Crossley, Margaret
    Vrbancic, Mirna
    BRAIN AND COGNITION, 2011, 76 (01) : 191 - 196
  • [45] The effectiveness of working memory training with the use of n-back task in a group of older adults
    Chojak, Agnieszka
    NEUROPSYCHIATRIA I NEUROPSYCHOLOGIA, 2019, 14 (1-2): : 9 - 16
  • [46] Novel n-back spatial working memory task using eye movement response
    Cameron B. Jeter
    Saumil S. Patel
    Anne B. Sereno
    Behavior Research Methods, 2011, 43 : 879 - 887
  • [47] The effects of psychotomimetic and putative cognitive-enhancing drugs on the performance of a n-back working memory task in rats
    Ko, Tracey
    Evenden, John
    PSYCHOPHARMACOLOGY, 2009, 202 (1-3) : 67 - 78
  • [48] Differential effects of wakeful rest, music and video game playing on working memory performance in the n-back task
    Kuschpel, Maxim S.
    Liu, Shuyan
    Schad, Daniel J.
    Heinzel, Stephan
    Heinz, Andreas
    Rapp, Michael A.
    FRONTIERS IN PSYCHOLOGY, 2015, 6
  • [49] Sub-processes of working memory in the N-back task: An investigation using ERPs
    Chen, Yung-Nien
    Mitra, Suvobrata
    Schlaghecken, Friederike
    CLINICAL NEUROPHYSIOLOGY, 2008, 119 (07) : 1546 - 1559
  • [50] An fMRI study of individual differences in working memory capacity in the N-back task.
    MacDonald, AW
    Perlstein, WM
    Noll, DC
    Carter, CS
    JOURNAL OF COGNITIVE NEUROSCIENCE, 1999, : 34 - 34