An EEG-based cross-subject interpretable CNN for game player expertise level classification

被引:11
|
作者
Lin, Liqi [1 ]
Li, Pengrui [1 ]
Wang, Qinghua [2 ]
Bai, Binnan [1 ]
Cui, Ruifang [3 ,4 ]
Yu, Zhenxia [1 ]
Gao, Dongrui [1 ,3 ]
Zhang, Yongqing [1 ]
机构
[1] Chengdu Univ Informat Technol, Sch Comp Sci, Chengdu 610225, Peoples R China
[2] Hubi Wuhan Publ Secur Bur, Wuhan 430070, Hubei, Peoples R China
[3] Univ Elect Sci & Technol China, Sch Life Sci & Technol, Chengdu 611731, Peoples R China
[4] Univ Elect Sci & Technol China, Clin Hosp, Chengdu Brain Sci Inst, MOE Key Lab Neuroinformat, Chengdu 610054, Peoples R China
基金
中国国家自然科学基金;
关键词
Electroencephalography (EEG); Game player; Depthwise separable convolution; Cross-subject; Interpretable technology; COGNITIVE FUNCTIONS; VIDEO; PERFORMANCE; CMARS;
D O I
10.1016/j.eswa.2023.121658
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Electroencephalogram (EEG) signals have been demonstrated to be an effective method for game player expertise level classification, as it can reflect the activity state of the player's brain during the game task. Although many efforts have been made to classify the expertise level of game players based on EEG signals, existing methods still need to be improved in identifying common brain patterns across different subjects. In this article, we propose a Spatiotemporal-Based Brain Pattern Recognition Network (BPR-STNet), which uses depthwise separable convolution to extract the spatiotemporal features of EEG signals and incorporates Gradient-weighted Class Activation Mapping (Grad-CAM) interpretable technology to explore common brain patterns among different subjects. To evaluate the model's performance, we use non-invasive wearable devices to collect EEG signals from 19 subjects during the game process. The results of the leave-one-out cross-subject experiments demonstrate that the average accuracy of the model's game player expertise level classification is 82%-86.32% in the five frequency bands (6, 0, a, /3, y). Among them, the y frequency band has the highest accuracy of 86.32%. More importantly, the average accuracy of our method is 1.56%-5.79% higher than the state-of-the-art deep learning methods. Moreover, interpretable results indicate the model can learn biologically significant features from EEG frequency bands. Overall, this study can offer a new idea of using deep learning to explore common brain patterns and features among different subjects at the same level. The BPR-STNet code is available at https://github.com/L000077/BPR-STNet.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] EEG-Based Cross-Subject Driver Drowsiness Recognition With an Interpretable Convolutional Neural Network
    Cui, Jian
    Lan, Zirui
    Sourina, Olga
    Muller-Wittig, Wolfgang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (10) : 7921 - 7933
  • [2] EEG-based Cross-subject Mental Fatigue Recognition
    Liu, Yisi
    Lan, Zirui
    Cui, Jian
    Sourina, Olga
    Muller-Wittig, Wolfgang
    2019 INTERNATIONAL CONFERENCE ON CYBERWORLDS (CW), 2019, : 247 - 252
  • [3] Interpretable Cross-Subject EEG-Based Emotion Recognition Using Channel-Wise Features†
    Jin, Longbin
    Kim, Eun Yi
    SENSORS, 2020, 20 (23) : 1 - 18
  • [4] Temporal Focal Modulation Networks for EEG-Based Cross-Subject Motor Imagery Classification
    Hameed, Adel
    Fourati, Rahma
    Ammar, Boudour
    Sanchez-Medina, Javier
    Ltifi, Hela
    ADVANCES IN COMPUTATIONAL COLLECTIVE INTELLIGENCE, ICCCI 2024, PT II, 2024, 2166 : 445 - 457
  • [5] A Game Player Expertise Level Classification System Using Electroencephalography (EEG)
    Anwar, Syed Muhammad
    Saeed, Sanay Muhammad Umar
    Majid, Muhammad
    Usman, Saeeda
    Mehmood, Chaudhry Arshad
    Liu, Wei
    APPLIED SCIENCES-BASEL, 2018, 8 (01):
  • [6] Domain adaptation for EEG-based, cross-subject epileptic seizure prediction
    Jemal, Imene
    Abou-Abbas, Lina
    Henni, Khadidja
    Mitiche, Amar
    Mezghani, Neila
    FRONTIERS IN NEUROINFORMATICS, 2024, 18
  • [7] Evolutionary Ensemble Learning for EEG-Based Cross-Subject Emotion Recognition
    Zhang, Hanzhong
    Zuo, Tienyu
    Chen, Zhiyang
    Wang, Xin
    Sun, Poly Z. H.
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (07) : 3872 - 3881
  • [8] Enhancing Cross-Subject Motor Imagery Classification in EEG-Based Brain-Computer Interfaces by Using Multi-Branch CNN
    Chowdhury, Radia Rayan
    Muhammad, Yar
    Adeel, Usman
    SENSORS, 2023, 23 (18)
  • [9] Cross-Subject EEG-Based Emotion Recognition with Deep Domain Confusion
    Zhang, Weiwei
    Wang, Fei
    Jiang, Yang
    Xu, Zongfeng
    Wu, Shichao
    Zhang, Yahui
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2019, PT I, 2019, 11740 : 558 - 570
  • [10] Subject matching for cross-subject EEG-based recognition of driver states related to situation awareness
    Li, Ruilin
    Wang, Lipo
    Sourina, Olga
    METHODS, 2022, 202 : 136 - 143