Self-Supervised Learning for Electroencephalography

被引:175
|
作者
Rafiei, Mohammad H. [1 ]
Gauthier, Lynne V. [2 ]
Adeli, Hojjat [3 ,4 ]
Takabi, Daniel [1 ]
机构
[1] Georgia State Univ, Dept Comp Sci, Atlanta, GA 30303 USA
[2] Univ Massachusetts Lowell, Dept Phys Therapy & Kinesiol, Lowell, MA 01854 USA
[3] Ohio State Univ, Dept Biomed Informat, Columbus, OH 43210 USA
[4] Ohio State Univ, Dept Neurosci, Columbus, OH 43210 USA
关键词
Electroencephalography; Brain modeling; Data models; Task analysis; Machine learning; Training; Heuristic algorithms; Electroencephalography (EEG); machine learning; self-supervised learning (SSL); BRAIN-COMPUTER INTERFACE; EMOTION RECOGNITION; NEURAL-NETWORK; EEG; SYSTEM; CLASSIFICATION; SLEEP; FEATURES; FRAMEWORK; ALGORITHM;
D O I
10.1109/TNNLS.2022.3190448
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Decades of research have shown machine learning superiority in discovering highly nonlinear patterns embedded in electroencephalography (EEG) records compared with conventional statistical techniques. However, even the most advanced machine learning techniques require relatively large, labeled EEG repositories. EEG data collection and labeling are costly. Moreover, combining available datasets to achieve a large data volume is usually infeasible due to inconsistent experimental paradigms across trials. Self-supervised learning (SSL) solves these challenges because it enables learning from EEG records across trials with variable experimental paradigms, even when the trials explore different phenomena. It aggregates multiple EEG repositories to increase accuracy, reduce bias, and mitigate overfitting in machine learning training. In addition, SSL could be employed in situations where there is limited labeled training data, and manual labeling is costly. This article: 1) provides a brief introduction to SSL; 2) describes some SSL techniques employed in recent studies, including EEG; 3) proposes current and potential SSL techniques for future investigations in EEG studies; 4) discusses the cons and pros of different SSL techniques; and 5) proposes holistic implementation tips and potential future directions for EEG SSL practices.
引用
收藏
页码:1457 / 1471
页数:15
相关论文
共 50 条
  • [31] Self-Supervised Feature Enhancement: Applying Internal Pretext Task to Supervised Learning
    Xie, Tianshu
    Yang, Yuhang
    Ding, Zilin
    Cheng, Xuan
    Wang, Xiaomin
    Gong, Haigang
    Liu, Ming
    IEEE ACCESS, 2023, 11 : 1708 - 1717
  • [32] Sleep Stage Classification Via Multi-View Based Self-Supervised Contrastive Learning of EEG
    Zhao, Chen
    Wu, Wei
    Zhang, Haoyi
    Zhang, Ruiyan
    Zheng, Xinyue
    Kong, Xiangzeng
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (12) : 7068 - 7077
  • [33] Self-Supervised Learning From Multi-Sensor Data for Sleep Recognition
    Zhao, Aite
    Dong, Junyu
    Zhou, Huiyu
    IEEE ACCESS, 2020, 8 (08): : 93907 - 93921
  • [34] Self-Adaptive Training: Bridging Supervised and Self-Supervised Learning
    Huang, Lang
    Zhang, Chao
    Zhang, Hongyang
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (03) : 1362 - 1377
  • [35] Self-Supervised EEG Emotion Recognition Models Based on CNN
    Wang, Xingyi
    Ma, Yuliang
    Cammon, Jared
    Fang, Feng
    Gao, Yunyuan
    Zhang, Yingchun
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 : 1952 - 1962
  • [36] TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech
    Liu, Andy T.
    Li, Shang-Wen
    Lee, Hung-yi
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2021, 29 : 2351 - 2366
  • [37] Self-Supervised Learning of Graph Neural Networks: A Unified Review
    Xie, Yaochen
    Xu, Zhao
    Zhang, Jingtun
    Wang, Zhengyang
    Ji, Shuiwang
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (02) : 2412 - 2429
  • [38] Efficient Personalized Speech Enhancement Through Self-Supervised Learning
    Sivaraman, Aswin
    Kim, Minje
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2022, 16 (06) : 1342 - 1356
  • [39] A Generic Self-Supervised Framework of Learning Invariant Discriminative Features
    Ntelemis, Foivos
    Jin, Yaochu
    Thomas, Spencer A.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (09) : 12938 - 12952
  • [40] Embedding Global Contrastive and Local Location in Self-Supervised Learning
    Zhao, Wenyi
    Li, Chongyi
    Zhang, Weidong
    Yang, Lu
    Zhuang, Peixian
    Li, Lingqiao
    Fan, Kefeng
    Yang, Huihua
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (05) : 2275 - 2289