An EEG-based cross-subject interpretable CNN for game player expertise level classification

被引:11
作者
Lin, Liqi [1 ]
Li, Pengrui [1 ]
Wang, Qinghua [2 ]
Bai, Binnan [1 ]
Cui, Ruifang [3 ,4 ]
Yu, Zhenxia [1 ]
Gao, Dongrui [1 ,3 ]
Zhang, Yongqing [1 ]
机构
[1] Chengdu Univ Informat Technol, Sch Comp Sci, Chengdu 610225, Peoples R China
[2] Hubi Wuhan Publ Secur Bur, Wuhan 430070, Hubei, Peoples R China
[3] Univ Elect Sci & Technol China, Sch Life Sci & Technol, Chengdu 611731, Peoples R China
[4] Univ Elect Sci & Technol China, Clin Hosp, Chengdu Brain Sci Inst, MOE Key Lab Neuroinformat, Chengdu 610054, Peoples R China
基金
中国国家自然科学基金;
关键词
Electroencephalography (EEG); Game player; Depthwise separable convolution; Cross-subject; Interpretable technology; COGNITIVE FUNCTIONS; VIDEO; PERFORMANCE; CMARS;
D O I
10.1016/j.eswa.2023.121658
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Electroencephalogram (EEG) signals have been demonstrated to be an effective method for game player expertise level classification, as it can reflect the activity state of the player's brain during the game task. Although many efforts have been made to classify the expertise level of game players based on EEG signals, existing methods still need to be improved in identifying common brain patterns across different subjects. In this article, we propose a Spatiotemporal-Based Brain Pattern Recognition Network (BPR-STNet), which uses depthwise separable convolution to extract the spatiotemporal features of EEG signals and incorporates Gradient-weighted Class Activation Mapping (Grad-CAM) interpretable technology to explore common brain patterns among different subjects. To evaluate the model's performance, we use non-invasive wearable devices to collect EEG signals from 19 subjects during the game process. The results of the leave-one-out cross-subject experiments demonstrate that the average accuracy of the model's game player expertise level classification is 82%-86.32% in the five frequency bands (6, 0, a, /3, y). Among them, the y frequency band has the highest accuracy of 86.32%. More importantly, the average accuracy of our method is 1.56%-5.79% higher than the state-of-the-art deep learning methods. Moreover, interpretable results indicate the model can learn biologically significant features from EEG frequency bands. Overall, this study can offer a new idea of using deep learning to explore common brain patterns and features among different subjects at the same level. The BPR-STNet code is available at https://github.com/L000077/BPR-STNet.
引用
收藏
页数:12
相关论文
共 49 条
  • [1] Neuroimaging and cognitive functions in temporal lobe epilepsy: A review of the literature
    Allone, Cettina
    Lo Buono, Viviana
    Corallo, Francesco
    Pisani, Laura Rosa
    Pollicino, Patrizia
    Bramanti, Placido
    Marino, Silvia
    [J]. JOURNAL OF THE NEUROLOGICAL SCIENCES, 2017, 381 : 7 - 15
  • [2] Video game training enhances cognitive control in older adults
    Anguera, J. A.
    Boccanfuso, J.
    Rintoul, J. L.
    Al-Hashimi, O.
    Faraji, F.
    Janowich, J.
    Kong, E.
    Larraburo, Y.
    Rolle, C.
    Johnston, E.
    Gazzaley, A.
    [J]. NATURE, 2013, 501 (7465) : 97 - +
  • [3] A Game Player Expertise Level Classification System Using Electroencephalography (EEG)
    Anwar, Syed Muhammad
    Saeed, Sanay Muhammad Umar
    Majid, Muhammad
    Usman, Saeeda
    Mehmood, Chaudhry Arshad
    Liu, Wei
    [J]. APPLIED SCIENCES-BASEL, 2018, 8 (01):
  • [4] Arican E, 2022, ROM J INF SCI TECH, V25, P338
  • [5] Cortical activity of skilled performance in a complex sports related motor task
    Baumeister, Jochen
    Reinecke, Kirsten
    Liesen, Heinz
    Weiss, Michael
    [J]. EUROPEAN JOURNAL OF APPLIED PHYSIOLOGY, 2008, 104 (04) : 625 - 631
  • [6] Using EEG to Study Cognitive Development: Issues and Practices
    Bell, Martha Ann
    Cuevas, Kimberly
    [J]. JOURNAL OF COGNITION AND DEVELOPMENT, 2012, 13 (03) : 281 - 294
  • [7] Improvement of K-means Cluster Quality by Post Processing Resulted Clusters
    Borlea, Ioan-Daniel
    Precup, Radu-Emil
    Borlea, Alexandra-Bianca
    [J]. 8TH INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND QUANTITATIVE MANAGEMENT (ITQM 2020 & 2021): DEVELOPING GLOBAL DIGITAL ECONOMY AFTER COVID-19, 2022, 199 : 63 - 70
  • [8] Action video game experience reduces the cost of switching tasks
    Cain, Matthew S.
    Landau, Ayelet N.
    Shimamura, Arthur P.
    [J]. ATTENTION PERCEPTION & PSYCHOPHYSICS, 2012, 74 (04) : 641 - 647
  • [9] Voxel-MARS: a method for early detection of Alzheimer's disease by classification of structural brain MRI
    Cevik, Alper
    Weber, Gerhard-Wilhelm
    Eyuboglu, B. Murat
    Oguz, Kader Karli
    [J]. ANNALS OF OPERATIONS RESEARCH, 2017, 258 (01) : 31 - 57
  • [10] Chang CY, 2018, IEEE ENG MED BIO, P1242, DOI 10.1109/EMBC.2018.8512547