Decoding working-memory load during n-back task performance from high channel fNIRS data

被引:1
|
作者
Kothe, Christian [1 ]
Hanada, Grant [1 ]
Mullen, Sean [1 ]
Mullen, Tim [1 ]
机构
[1] Intheon, La Jolla, CA 92037 USA
关键词
Near-infrared spectroscopy; brain-computer interfaces; machine learning; high-density; workload; transfer learning; COGNITIVE CONTROL;
D O I
10.1088/1741-2552/ad731b
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective. Functional near-infrared spectroscopy (fNIRS) can measure neural activity through blood oxygenation changes in the brain in a wearable form factor, enabling unique applications for research in and outside the lab and in practical occupational settings. fNIRS has proven capable of measuring cognitive states such as mental workload, often using machine learning (ML) based brain-computer interfaces (BCIs). To date, this research has largely relied on probes with channel counts from under ten to several hundred, although recently a new class of wearable NIRS devices featuring thousands of channels has emerged. This poses unique challenges for ML classification, as fNIRS is typically limited by few training trials which results in severely under-determined estimation problems. So far, it is not well understood how such high-resolution data is best leveraged in practical BCIs and whether state-of-the-art or better performance can be achieved. Approach. To address these questions, we propose an ML strategy to classify working-memory load that relies on spatio-temporal regularization and transfer learning from other subjects in a combination that, to our knowledge, has not been used in previous fNIRS BCIs. The approach can be interpreted as an end-to-end generalized linear model and allows for a high degree of interpretability using channel-level or cortical imaging approaches. Main results. We show that using the proposed methodology, it is possible to achieve state-of-the-art decoding performance with high-resolution fNIRS data. We also replicated several state-of-the-art approaches on our dataset of 43 participants wearing a 3198 dual-channel NIRS device while performing the n-Back task and show that these existing methodologies struggle in the high-channel regime and are largely outperformed by the proposed pipeline. Significance. Our approach helps establish high-channel NIRS devices as a viable platform for state-of-the-art BCI and opens new applications using this class of headset while also enabling high-resolution model imaging and interpretation.
引用
收藏
页数:21
相关论文
共 50 条
  • [11] Decoding Mental Workload in Virtual Environments: A fNIRS Study using an Immersive n-back Task
    Putze, Felix
    Herff, Christian
    Tremmel, Christoph
    Schultz, Tanja
    Krusienski, Dean J.
    2019 41ST ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2019, : 3103 - 3106
  • [12] Competition for working memory resources in the n-back task: No free lunch
    McGinnis, Scott M.
    Chong, Hyemi
    Riis, Jenna L.
    Wolk, David A.
    Daffner, Kirk R.
    NEUROLOGY, 2007, 68 (12) : A12 - A12
  • [13] Prefrontal activation and pupil dilation during n-back task performance: A combined fNIRS and pupillometry study
    Yeung, Michael K.
    Lee, Tsz L.
    Han, Yvonne M. Y.
    Chan, Agnes S.
    NEUROPSYCHOLOGIA, 2021, 159
  • [14] Activation of the prefrontal cortex during a visual n-back working memory task with varying memory load: a Near Infrared Spectroscopy Study
    Molteni, Erika
    Butti, Michele
    Bianchi, Anna M.
    Reni, Gianluigi
    2008 30TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-8, 2008, : 4024 - +
  • [15] The Effects of Sleep Deprivation in Working Memory Using the N-back Task
    Martinez-Cancino, D. P.
    Azpiroz-Leehan, J.
    Jimenez-Angeles, L.
    VI LATIN AMERICAN CONGRESS ON BIOMEDICAL ENGINEERING (CLAIB 2014), 2014, 49 : 421 - 424
  • [16] Is the N-Back Task a Valid Neuropsychological Measure for Assessing Working Memory?
    Miller, K. M.
    Price, C. C.
    Okun, M. S.
    Montijo, H.
    Bowers, D.
    ARCHIVES OF CLINICAL NEUROPSYCHOLOGY, 2009, 24 (07) : 711 - 717
  • [17] Emotional body expressions facilitate working memory: Evidence from the n-back task
    Zhang, Mingming
    Li, Ping
    Yu, Lu
    Ren, Jie
    Jia, Shuxin
    Wang, Chaolun
    He, Weiqi
    Luo, Wenbo
    PSYCH JOURNAL, 2023, 12 (02) : 178 - 184
  • [18] Working memory reloaded: tyrosine repletes updating in the N-back task
    Colzato, Lorenza S.
    Jongkees, Bryant J.
    Sellaro, Roberta
    Hommel, Bernhard
    FRONTIERS IN BEHAVIORAL NEUROSCIENCE, 2013, 7
  • [19] Electroencephalography Based Analysis of Working Memory Load and Affective Valence in an N-back Task with Emotional Stimuli
    Grissmann, Sebastian
    Faller, Josef
    Scharinger, Christian
    Spueler, Martin
    Gerjets, Peter
    FRONTIERS IN HUMAN NEUROSCIENCE, 2017, 11
  • [20] REDESIGN OF THE CLASSIC N-BACK WORKING MEMORY TASK AS AN APPLIED GAME
    Vogler, Christian
    Aeberhard, Andreas
    Gschwind, Leo
    Egli, Tobias
    Cheeramkunnel, Janson
    Gecen, Ferya
    Huge, Matthias
    Hochuli, David
    Jahanabadi, Shahab
    Kohler, Tobias
    Neijt, Joep
    Schlappi, Sulamith
    Winterhalter, Annika
    de Quervain, Dominique J. -F.
    Papassotiropoulos, Andreas
    EUROPEAN NEUROPSYCHOPHARMACOLOGY, 2017, 27 : S306 - S306