Cross-Task Cognitive Workload Recognition Based on EEG and Domain Adaptation

被引:36
|
作者
Zhou, Yueying [1 ]
Xu, Ziming [1 ]
Niu, Yifan [2 ]
Wang, Pengpai [1 ]
Wen, Xuyun [1 ]
Wu, Xia [2 ]
Zhang, Daoqiang [1 ,3 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, MIIT Key Lab Pattern Anal & Machine Intelligence, Coll Comp Sci & Technol, Nanjing 211106, Peoples R China
[2] Beijing Normal Univ, Engn Res Ctr Intelligent Technol & Educ Applicat, Sch Artificial Intelligence, Minist Educ, Beijing 100875, Peoples R China
[3] Minist Educ, Engn Res Ctr Tradit Chinese Med Intelligent Rehab, Shanghai 201101, Peoples R China
基金
中国国家自然科学基金;
关键词
Task analysis; Electroencephalography; Brain modeling; Adaptation models; Probability distribution; Data models; Mathematical models; Cognitive workload; cross-task recognition; electroencephalogram (EEG); domain adaptation; CLASSIFICATION; DYNAMICS; SIGNALS;
D O I
10.1109/TNSRE.2022.3140456
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Cognitive workload recognition is pivotal to maintain the operator's health and prevent accidents in the human-robot interaction condition. So far, the focus of workload research is mostly restricted to a single task, yet cross-task cognitive workload recognition has remained a challenge. Furthermore, when extending to a new workload condition, the discrepancy of electroencephalogram (EEG) signals across various cognitive tasks limits the generalization of the existed model. To tackle this problem, we propose to construct the EEG-based cross-task cognitive workload recognition models using domain adaptation methods in a leave-one-task-out cross-validation setting, where we view any task of each subject as a domain. Specifically, we first design a fine-grained workload paradigm including working memory and mathematic addition tasks. Then, we explore four domain adaptation methods to bridge the discrepancy between the two different tasks. Finally, based on the supporting vector machine classifier, we conduct experiments to classify the low and high workload levels on a private EEG dataset. Experimental results demonstrate that our proposed task transfer framework outperforms the non-transfer classifier with improvements of 3% to 8% in terms of mean accuracy, and the transfer joint matching (TJM) consistently achieves the best performance.
引用
收藏
页码:50 / 60
页数:11
相关论文
共 50 条
  • [1] Cross-Subject Cognitive Workload Recognition Based on EEG and Deep Domain Adaptation
    Zhou, Yueying
    Wang, Pengpai
    Gong, Peiliang
    Wei, Fulin
    Wen, Xuyun
    Wu, Xia
    Zhang, Daoqiang
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [2] Cross-Task Mental Workload Recognition Based on EEG Tensor Representation and Transfer Learning
    Guan, Kai
    Zhang, Zhimin
    Liu, Tao
    Niu, Haijun
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 : 2632 - 2639
  • [3] Using Semi-Supervised Domain Adaptation to Enhance EEG-Based Cross-Task Mental Workload Classification Performance
    Wang, Tao
    Ke, Yufeng
    Huang, Yichao
    He, Feng
    Zhong, Wenxiao
    Liu, Shuang
    Ming, Dong
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (12) : 7032 - 7039
  • [4] Cross-task cognitive workload estimation using eye tracking
    Yang, Lin
    Wang, Lei
    Xu, Wenchang
    Wang, Biao
    Ren, Hanbin
    Yang, Aijuan
    SIGNAL IMAGE AND VIDEO PROCESSING, 2025, 19 (05)
  • [5] Cross-task cognitive workload recognition using a dynamic residual network with attention mechanism based on neurophysiological signals
    Ji, Zhangyifan
    Tang, Jiehao
    Wang, Qi
    Xie, Xin
    Liu, Jiali
    Yin, Zhong
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2023, 230
  • [6] SAR Target Recognition Based on Cross-Domain and Cross-Task Transfer Learning
    Wang, Ke
    Zhang, Gong
    Leung, Henry
    IEEE ACCESS, 2019, 7 : 153391 - 153399
  • [7] A generalized depression recognition framework based on cross-center and cross-task EEG signals
    Liu, Xuesong
    Qu, Shanshan
    Luo, Gang
    Yan, Chang
    Wang, Dixin
    Chu, Na
    Tian, Fuze
    Zhu, Jing
    Li, Xiaowei
    Sun, Shuting
    Hu, Bin
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 104
  • [8] Cross-Task Fault Diagnosis Based on Deep Domain Adaptation With Local Feature Learning
    Tian, Ying
    Tang, Yin
    Peng, Xin
    IEEE ACCESS, 2020, 8 : 127546 - 127559
  • [9] Air traffic control speech recognition system cross-task & speaker adaptation
    de Cordoba, R.
    Ferreiros, J.
    San-Segundo, R.
    Macias-Guarasa, J.
    Montero, J. M.
    Fernandez, F.
    D'Haro, L. F.
    Pardo, J. M.
    IEEE AEROSPACE AND ELECTRONIC SYSTEMS MAGAZINE, 2006, 21 (09) : 12 - 17
  • [10] Unifying Learning to Rank and Domain Adaptation: Enabling Cross-Task Document Scoring
    Zhou, Mianwei
    Chang, Kevin Chen-Chuan
    PROCEEDINGS OF THE 20TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING (KDD'14), 2014, : 781 - 790