Decoding working-memory load during n-back task performance from high channel fNIRS data

被引:1
|
作者
Kothe, Christian [1 ]
Hanada, Grant [1 ]
Mullen, Sean [1 ]
Mullen, Tim [1 ]
机构
[1] Intheon, La Jolla, CA 92037 USA
关键词
Near-infrared spectroscopy; brain-computer interfaces; machine learning; high-density; workload; transfer learning; COGNITIVE CONTROL;
D O I
10.1088/1741-2552/ad731b
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective. Functional near-infrared spectroscopy (fNIRS) can measure neural activity through blood oxygenation changes in the brain in a wearable form factor, enabling unique applications for research in and outside the lab and in practical occupational settings. fNIRS has proven capable of measuring cognitive states such as mental workload, often using machine learning (ML) based brain-computer interfaces (BCIs). To date, this research has largely relied on probes with channel counts from under ten to several hundred, although recently a new class of wearable NIRS devices featuring thousands of channels has emerged. This poses unique challenges for ML classification, as fNIRS is typically limited by few training trials which results in severely under-determined estimation problems. So far, it is not well understood how such high-resolution data is best leveraged in practical BCIs and whether state-of-the-art or better performance can be achieved. Approach. To address these questions, we propose an ML strategy to classify working-memory load that relies on spatio-temporal regularization and transfer learning from other subjects in a combination that, to our knowledge, has not been used in previous fNIRS BCIs. The approach can be interpreted as an end-to-end generalized linear model and allows for a high degree of interpretability using channel-level or cortical imaging approaches. Main results. We show that using the proposed methodology, it is possible to achieve state-of-the-art decoding performance with high-resolution fNIRS data. We also replicated several state-of-the-art approaches on our dataset of 43 participants wearing a 3198 dual-channel NIRS device while performing the n-Back task and show that these existing methodologies struggle in the high-channel regime and are largely outperformed by the proposed pipeline. Significance. Our approach helps establish high-channel NIRS devices as a viable platform for state-of-the-art BCI and opens new applications using this class of headset while also enabling high-resolution model imaging and interpretation.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] Working memory, attention control, and the N-back task:: A question of construct validity
    Kane, Michael J.
    Conway, Andrew R. A.
    Miura, Timothy K.
    Colflesh, Gregory J. H.
    JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 2007, 33 (03) : 615 - 622
  • [32] Clinical utility of the N-back task in functional neuroimaging studies of working memory
    Jacola, Lisa M.
    Willard, Victoria W.
    Ashford, Jason M.
    Ogg, Robert J.
    Scoggins, Matthew A.
    Jones, Melissa M.
    Wu, Shengjie
    Conklin, Heather M.
    JOURNAL OF CLINICAL AND EXPERIMENTAL NEUROPSYCHOLOGY, 2014, 36 (08) : 875 - 886
  • [33] The validity of d prime as a working memory index: Results from the "Bergen n-back task"
    Haatveit, Beathe C.
    Sundet, Kjetil
    Hugdahl, Kenneth
    Ueland, Torill
    Melle, Ingrid
    Andreassen, Ole A.
    JOURNAL OF CLINICAL AND EXPERIMENTAL NEUROPSYCHOLOGY, 2010, 32 (08) : 871 - 880
  • [34] CHANGING OF WORKING MEMORY IN THE N-BACK TASK IN WOMEN WITH PMS: AN ERP STUDY
    Lin, Tzu-Ya
    Wu, Wen-Lan
    Liang, Jing-Min
    Shih, Huei-Yu
    PSYCHOPHYSIOLOGY, 2013, 50 : S62 - S63
  • [35] Neural activity during the "n-back" working memory task predicts relapse risk in alcohol dependence
    Charlet, K.
    Beck, A.
    Jorde, A.
    Vollstaedt-Klein, S.
    Gallinat, J.
    Walter, H.
    Kiefer, F.
    Heinz, A.
    EUROPEAN NEUROPSYCHOPHARMACOLOGY, 2014, 24 : S309 - S310
  • [36] Group analysis and classification of working memory task conditions using electroencephalogram cortical currents during an n-back task
    Yoshiiwa, Shinnosuke
    Takano, Hironobu
    Ido, Keisuke
    Kawato, Mitsuo
    Morishige, Ken-ichi
    FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [37] Decoding different working memory states during an operation span task from prefrontal fNIRS signals
    Chen, Ting
    Zhao, Cui
    Pan, Xingyu
    Qu, Junda
    Wei, Jing
    Li, Chunlin
    Liang, Ying
    Zhang, Xu
    BIOMEDICAL OPTICS EXPRESS, 2021, 12 (06) : 3495 - 3511
  • [38] Mental workload during n-back task-quantified in the prefrontal cortex using fNIRS
    Herff, Christian
    Heger, Dominic
    Fortmann, Ole
    Hennrich, Johannes
    Putze, Felix
    Schultz, Tanja
    FRONTIERS IN HUMAN NEUROSCIENCE, 2014, 7
  • [39] Author Correction: Near transfer to an unrelated N-back task mediates the effect of N-back working memory training on matrix reasoning
    Anja Pahor
    Aaron R. Seitz
    Susanne M. Jaeggi
    Nature Human Behaviour, 2023, 7 : 292 - 292
  • [40] Uncovering Dynamic Brain Reconfiguration in MEG Working Memory n-Back Task Using Topological Data Analysis
    Duman, Ali Nabi
    Tatar, Ahmet Emin
    Pirim, Harun
    BRAIN SCIENCES, 2019, 9 (06)